[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:27 dist-test-slave-jq4t krb5kdc[24476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:27 dist-test-slave-jq4t krb5kdc[24476](info): set up 2 sockets
Aug 09 18:56:27 dist-test-slave-jq4t krb5kdc[24476](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 18:56:29.018988 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:29.145301 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:36011
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:36011
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:29.231242 24493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:29.231448 24493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:29.231472 24493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:29.232656 24493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:29.232697 24493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:29.232712 24493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:29.232724 24493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:29.232764 24493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:29.234248 24493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:36011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:36011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:29.234514 24493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:29.234756 24493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:29.240242 24503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:29.240248 24506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.240298 24493 server_base.cc:1034] running on GCE node
W20260809 18:56:29.240301 24501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.240703 24493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:29.241030 24493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:29.242173 24493 hybrid_clock.cc:648] HybridClock initialized: now 1786301789242120 us; error 74 us; skew 500 ppm
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:29.247946 24493 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:29.248466 24493 webserver.cc:460] Webserver started at http://127.23.229.62:35573/ using document root <none> and password file <none>
I20260809 18:56:29.248762 24493 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:29.248808 24493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:29.248991 24493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:29.250197 24493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "e869ef33c18241d4a634a4cbfaa3187c"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "f06c05f2fb89b19a714b665a1e2cb242"
server_key_iv: "7152ec7831d7357d159052316690f9b4"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.250593 24493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "e869ef33c18241d4a634a4cbfaa3187c"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "f06c05f2fb89b19a714b665a1e2cb242"
server_key_iv: "7152ec7831d7357d159052316690f9b4"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.252060 24493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:29.252873 24517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.253101 24493 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:29.253211 24493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "e869ef33c18241d4a634a4cbfaa3187c"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "f06c05f2fb89b19a714b665a1e2cb242"
server_key_iv: "7152ec7831d7357d159052316690f9b4"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.253288 24493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:29.261547 24493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:29.263465 24493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:29.263630 24493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:29.267999 24493 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:36011
I20260809 18:56:29.268031 24590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:36011 every 8 connection(s)
I20260809 18:56:29.268433 24493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:29.269436 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:29.270953 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24493
I20260809 18:56:29.271047 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:29.271696 24468 external_mini_cluster.cc:1428] Setting key da462fd8d1a39bb05b614c7034069868
I20260809 18:56:29.272012 24591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c: Bootstrap starting.
I20260809 18:56:29.272895 24591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:29.273272 24591 log.cc:824] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:29.274052 24591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c: No bootstrap required, opened a new log
I20260809 18:56:29.275997 24591 raft_consensus.cc:348] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e869ef33c18241d4a634a4cbfaa3187c" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36011 } }
I20260809 18:56:29.276178 24591 raft_consensus.cc:374] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:29.276217 24591 raft_consensus.cc:729] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e869ef33c18241d4a634a4cbfaa3187c, State: Initialized, Role: FOLLOWER
I20260809 18:56:29.276377 24591 consensus_queue.cc:260] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e869ef33c18241d4a634a4cbfaa3187c" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36011 } }
I20260809 18:56:29.276453 24591 raft_consensus.cc:388] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:29.276525 24591 raft_consensus.cc:482] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:29.276582 24591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:29.277489 24591 raft_consensus.cc:504] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e869ef33c18241d4a634a4cbfaa3187c" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36011 } }
I20260809 18:56:29.277586 24591 leader_election.cc:302] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e869ef33c18241d4a634a4cbfaa3187c; no voters:
I20260809 18:56:29.277823 24591 leader_election.cc:288] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:29.277860 24597 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:29.277980 24597 raft_consensus.cc:686] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [term 1 LEADER]: Becoming Leader. State: Replica: e869ef33c18241d4a634a4cbfaa3187c, State: Running, Role: LEADER
I20260809 18:56:29.278131 24591 sys_catalog.cc:564] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:29.278172 24597 consensus_queue.cc:237] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e869ef33c18241d4a634a4cbfaa3187c" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36011 } }
I20260809 18:56:29.278622 24600 sys_catalog.cc:455] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e869ef33c18241d4a634a4cbfaa3187c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e869ef33c18241d4a634a4cbfaa3187c" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36011 } } }
I20260809 18:56:29.278643 24598 sys_catalog.cc:455] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e869ef33c18241d4a634a4cbfaa3187c. Latest consensus state: current_term: 1 leader_uuid: "e869ef33c18241d4a634a4cbfaa3187c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e869ef33c18241d4a634a4cbfaa3187c" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36011 } } }
I20260809 18:56:29.278736 24600 sys_catalog.cc:458] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:29.278771 24598 sys_catalog.cc:458] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:29.278968 24605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:29.279619 24605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:29.282891 24605 catalog_manager.cc:1347] Generated new cluster ID: 4f4663dd9f81448a9cac31ee98fe9eca
I20260809 18:56:29.283064 24605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:29.290977 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.272885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52398 (local address 127.23.229.62:36011)
0809 18:56:29.273098 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.273106 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.273419 (+ 313us) server_negotiation.cc:407] Connection header received
0809 18:56:29.275948 (+ 2529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.275958 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.276024 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.276179 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.278203 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.279609 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.281269 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.281855 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.281970 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.286667 (+ 4697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.286672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.286672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.286684 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.288742 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.289279 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.289282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.289283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.289403 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.289763 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.289764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.289764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.290081 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.290219 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.290580 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.290723 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":91,"threads_started":1}
I20260809 18:56:29.305673 24605 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:29.306406 24605 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:29.310737 24605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e869ef33c18241d4a634a4cbfaa3187c: Generated new TSK 0
I20260809 18:56:29.310973 24605 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:29.349761 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36011
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:29.461035 24621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:29.461266 24621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:29.461293 24621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:29.462443 24621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:29.462487 24621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:29.462515 24621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:29.463956 24621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36011
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:29.464160 24621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:29.464360 24621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:29.469692 24629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:29.469723 24633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.469921 24621 server_base.cc:1034] running on GCE node
W20260809 18:56:29.469934 24630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.470211 24621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:29.470517 24621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:29.471668 24621 hybrid_clock.cc:648] HybridClock initialized: now 1786301789471628 us; error 67 us; skew 500 ppm
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:29.474402 24621 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:29.474826 24621 webserver.cc:460] Webserver started at http://127.23.229.1:45733/ using document root <none> and password file <none>
I20260809 18:56:29.475032 24621 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:29.475075 24621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:29.475167 24621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:29.476229 24621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "0b79fa1bdd9046228f6de6b6df6555a3"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "ac1600e05c0df388c33ce3270a147a6c"
server_key_iv: "65d2c005aca4b82b37b4058c6bd9b794"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.476679 24621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "0b79fa1bdd9046228f6de6b6df6555a3"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "ac1600e05c0df388c33ce3270a147a6c"
server_key_iv: "65d2c005aca4b82b37b4058c6bd9b794"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.478070 24621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:29.479012 24642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.479231 24621 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:29.479354 24621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "0b79fa1bdd9046228f6de6b6df6555a3"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "ac1600e05c0df388c33ce3270a147a6c"
server_key_iv: "65d2c005aca4b82b37b4058c6bd9b794"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.479449 24621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:29.487016 24621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:29.488989 24621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:29.489159 24621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:29.489400 24621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:29.489737 24621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:29.489794 24621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.489837 24621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:29.489863 24621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.496277 24621 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:43577
I20260809 18:56:29.496332 24800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:43577 every 8 connection(s)
I20260809 18:56:29.496773 24621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:29.506929 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.497754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:60061 (local address 127.23.229.62:36011)
0809 18:56:29.497815 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.497817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.498016 (+ 199us) server_negotiation.cc:407] Connection header received
0809 18:56:29.498524 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.498525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.498540 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.498595 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.499695 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.500221 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.501316 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.501537 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.501597 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.503851 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.503853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.503853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.503860 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.505460 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.505810 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.505811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.505811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.505863 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.506179 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.506181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.506182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.506340 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.506429 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.506730 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.506834 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:56:29.507109 24803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.497723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:36011 (local address 127.23.229.1:60061)
0809 18:56:29.497897 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:29.497937 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:29.498430 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:29.498654 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:29.498658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:29.499380 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:29.499606 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:29.499611 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.500309 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.500310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:29.501217 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:29.501220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.501621 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.501622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:29.501729 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.502261 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:29.502269 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:29.503754 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:29.505528 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:29.505535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:29.505537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:29.505744 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:29.505963 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:29.505964 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:29.505965 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:29.506101 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:29.506432 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:29.506441 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:29.506582 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 18:56:29.506689 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 18:56:29.506856 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260809 18:56:29.506969 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24621
I20260809 18:56:29.507467 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:29.507665 24468 external_mini_cluster.cc:1428] Setting key 863c2aca7627d9a2e916c90d203e5046
I20260809 18:56:29.507702 24801 heartbeater.cc:347] Connected to a master server at 127.23.229.62:36011
I20260809 18:56:29.507824 24801 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:29.508029 24801 heartbeater.cc:511] Master 127.23.229.62:36011 requested a full tablet report, sending...
I20260809 18:56:29.508687 24543 ts_manager.cc:194] Registered new tserver with Master: 0b79fa1bdd9046228f6de6b6df6555a3 (127.23.229.1:43577)
I20260809 18:56:29.509475 24543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:60061
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:29.536239 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36011
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:29.622747 24807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:29.622975 24807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:29.623001 24807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:29.624168 24807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:29.624214 24807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:29.624241 24807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:29.625751 24807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36011
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:29.625988 24807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:29.626219 24807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:29.631394 24813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:29.631423 24815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.631464 24807 server_base.cc:1034] running on GCE node
W20260809 18:56:29.631431 24819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.631826 24807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:29.632100 24807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:29.633280 24807 hybrid_clock.cc:648] HybridClock initialized: now 1786301789633269 us; error 50 us; skew 500 ppm
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:29.635998 24807 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:29.636572 24807 webserver.cc:460] Webserver started at http://127.23.229.2:43579/ using document root <none> and password file <none>
I20260809 18:56:29.636811 24807 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:29.636878 24807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:29.637020 24807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:29.638124 24807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "df75bd39af1d40d481fb7797b5213b2a"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "035cd4fb71fb9cf79ac14b5c23ca5a93"
server_key_iv: "24469b89356f519b3dd17371b96bbeb2"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.638506 24807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "df75bd39af1d40d481fb7797b5213b2a"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "035cd4fb71fb9cf79ac14b5c23ca5a93"
server_key_iv: "24469b89356f519b3dd17371b96bbeb2"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.639952 24807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:29.640838 24827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.641021 24807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:29.641129 24807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "df75bd39af1d40d481fb7797b5213b2a"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "035cd4fb71fb9cf79ac14b5c23ca5a93"
server_key_iv: "24469b89356f519b3dd17371b96bbeb2"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.641215 24807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:29.654351 24807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:29.656949 24807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:29.657126 24807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:29.657387 24807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:29.657732 24807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:29.657788 24807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.657823 24807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:29.657866 24807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.664315 24807 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:33523
I20260809 18:56:29.664361 24989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:33523 every 8 connection(s)
I20260809 18:56:29.664760 24807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:29.672541 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24807
I20260809 18:56:29.672638 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:29.672868 24468 external_mini_cluster.cc:1428] Setting key 2976fed15bd1b6ddb0eb617609e070b9
I20260809 18:56:29.676213 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.666791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:56531 (local address 127.23.229.62:36011)
0809 18:56:29.666870 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.666872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.667084 (+ 212us) server_negotiation.cc:407] Connection header received
0809 18:56:29.667576 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.667577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.667587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.667649 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.668707 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.669233 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.670242 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.670434 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.670486 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.672814 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.672817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.672817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.672826 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.674574 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.675032 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.675033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.675034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.675117 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.675392 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.675394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.675394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.675532 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.675620 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.675981 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.676088 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:56:29.676240 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.666758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:36011 (local address 127.23.229.2:56531)
0809 18:56:29.666949 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:29.666992 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:29.667484 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:29.667727 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:29.667731 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:29.668342 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:29.668622 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:29.668627 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.669321 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.669322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:29.670163 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:29.670165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.670506 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.670507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:29.670612 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.671116 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:29.671125 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:29.672686 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:29.674681 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:29.674690 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:29.674693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:29.674934 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:29.675203 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:29.675204 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:29.675204 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:29.675323 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:29.675628 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:29.675638 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:29.675827 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 18:56:29.675937 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 18:56:29.676070 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":116,"threads_started":1}
I20260809 18:56:29.676826 24990 heartbeater.cc:347] Connected to a master server at 127.23.229.62:36011
I20260809 18:56:29.676955 24990 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:29.677141 24990 heartbeater.cc:511] Master 127.23.229.62:36011 requested a full tablet report, sending...
I20260809 18:56:29.677641 24543 ts_manager.cc:194] Registered new tserver with Master: df75bd39af1d40d481fb7797b5213b2a (127.23.229.2:33523)
I20260809 18:56:29.678174 24543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:56531
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:29.703418 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36011
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:29.790112 24995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:29.790331 24995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:29.790357 24995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:29.791545 24995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:29.791590 24995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:29.791617 24995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:29.793170 24995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36011
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:29.793429 24995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:29.793661 24995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:29.798952 25007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:29.798959 25009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.799009 24995 server_base.cc:1034] running on GCE node
W20260809 18:56:29.799016 25005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:29.799387 24995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:29.799662 24995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:29.800845 24995 hybrid_clock.cc:648] HybridClock initialized: now 1786301789800833 us; error 46 us; skew 500 ppm
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:29.803695 24995 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:29.804172 24995 webserver.cc:460] Webserver started at http://127.23.229.3:43985/ using document root <none> and password file <none>
I20260809 18:56:29.804445 24995 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:29.804562 24995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:29.804731 24995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:29.805820 24995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "e4e5416f99554c9eba8fb5cf97ec385d"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "9f183786ef70a3200b1b558cfc1b8cb1"
server_key_iv: "3822620e1207c5607a860c9eb95a7f05"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.806209 24995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "e4e5416f99554c9eba8fb5cf97ec385d"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "9f183786ef70a3200b1b558cfc1b8cb1"
server_key_iv: "3822620e1207c5607a860c9eb95a7f05"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.807587 24995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:29.808328 25019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.808559 24995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:29.808662 24995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "e4e5416f99554c9eba8fb5cf97ec385d"
format_stamp: "Formatted at 2026-08-09 18:56:29 on dist-test-slave-jq4t"
server_key: "9f183786ef70a3200b1b558cfc1b8cb1"
server_key_iv: "3822620e1207c5607a860c9eb95a7f05"
server_key_version: "encryptionkey@0"
I20260809 18:56:29.808751 24995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:29.820145 24995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:29.822067 24995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:29.822238 24995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:29.822489 24995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:29.822824 24995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:29.822881 24995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.822925 24995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:29.822952 24995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:29.829174 24995 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:44817
I20260809 18:56:29.829208 25178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:44817 every 8 connection(s)
I20260809 18:56:29.829581 24995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:29.838742 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.830554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:41999 (local address 127.23.229.62:36011)
0809 18:56:29.830627 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.830629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.830846 (+ 217us) server_negotiation.cc:407] Connection header received
0809 18:56:29.831338 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.831339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.831350 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.831411 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.832357 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.832931 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.833895 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.834084 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.834139 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.836250 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.836251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.836252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.836259 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.837561 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.837924 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.837924 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.837925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.837987 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.838219 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.838220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.838220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.838322 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.838374 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.838612 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.838675 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:56:29.838948 25182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.830523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:36011 (local address 127.23.229.3:41999)
0809 18:56:29.830690 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:29.830734 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:29.831249 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:29.831474 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:29.831477 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:29.832070 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:29.832273 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:29.832278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.833011 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.833012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:29.833819 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:29.833821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.834162 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.834163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:29.834271 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.834819 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:29.834828 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:29.836168 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:29.837639 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:29.837646 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:29.837648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:29.837856 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:29.838046 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:29.838046 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:29.838046 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:29.838159 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:29.838377 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:29.838381 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:29.838501 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 18:56:29.838584 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:56:29.838700 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260809 18:56:29.839421 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24995
I20260809 18:56:29.839509 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:29.839598 25179 heartbeater.cc:347] Connected to a master server at 127.23.229.62:36011
I20260809 18:56:29.839679 24468 external_mini_cluster.cc:1428] Setting key b5321dacc55a890a21317fa6d631a69b
I20260809 18:56:29.839708 25179 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:29.839886 25179 heartbeater.cc:511] Master 127.23.229.62:36011 requested a full tablet report, sending...
I20260809 18:56:29.840286 24543 ts_manager.cc:194] Registered new tserver with Master: e4e5416f99554c9eba8fb5cf97ec385d (127.23.229.3:44817)
I20260809 18:56:29.840816 24543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:41999
I20260809 18:56:29.840929 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:29.865118 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.857500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43808 (local address 127.23.229.1:43577)
0809 18:56:29.857680 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.857693 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.857704 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:29.857734 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.857735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.857751 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.857830 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.858416 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.859154 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.859854 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.860183 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.860237 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.862521 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.862530 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.862531 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.862538 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.864038 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.864360 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.864362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.864363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.864421 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.864641 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.864642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.864642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.864785 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.864910 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.864965 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.865035 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":102,"threads_started":1}
W20260809 18:56:29.865507 24679 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43808
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:56:29 dist-test-slave-jq4t krb5kdc[24476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:29.889227 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.881859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43818 (local address 127.23.229.1:43577)
0809 18:56:29.881943 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.881945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.882034 (+ 89us) server_negotiation.cc:407] Connection header received
0809 18:56:29.882145 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.882146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.882164 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.882237 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.882853 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.883444 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.884240 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.884454 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.884578 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.886800 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.886802 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.886803 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.886811 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.888028 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.888374 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.888376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.888376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.888438 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.888694 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.888696 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.888696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.888802 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.888936 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.889025 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.889110 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 18:56:29.889827 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24621
I20260809 18:56:29.903826 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24807
I20260809 18:56:29.932377 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24995
I20260809 18:56:29.942651 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24493
2026-08-09T18:56:29Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2199 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:30 dist-test-slave-jq4t krb5kdc[25199](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:30 dist-test-slave-jq4t krb5kdc[25199](info): set up 2 sockets
Aug 09 18:56:30 dist-test-slave-jq4t krb5kdc[25199](info): commencing operation
krb5kdc: starting...
W20260809 18:56:31.186290 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:31 dist-test-slave-jq4t krb5kdc[25199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:31.311604 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:46563
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:46563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:31.399341 25219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:31.399569 25219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:31.399592 25219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:31.400856 25219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:31.400900 25219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:31.400915 25219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:31.400951 25219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:31.400978 25219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:31.402518 25219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:46563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:46563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:31.402786 25219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:31.403023 25219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:31.408218 25229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:31.408226 25226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:31.408247 25219 server_base.cc:1034] running on GCE node
W20260809 18:56:31.408200 25227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:31.408679 25219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:31.409003 25219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:31.410159 25219 hybrid_clock.cc:648] HybridClock initialized: now 1786301791410137 us; error 46 us; skew 500 ppm
Aug 09 18:56:31 dist-test-slave-jq4t krb5kdc[25199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:31.412932 25219 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:31.413425 25219 webserver.cc:460] Webserver started at http://127.23.229.62:37857/ using document root <none> and password file <none>
I20260809 18:56:31.413686 25219 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:31.413757 25219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:31.413910 25219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:31.415043 25219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "d1c2244b3e004b22907a1499979681d1"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "52be9533ac9c10ed71828a140374306b"
server_key_iv: "db5d8b61a1635664a588a10b5ac85888"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.415431 25219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "d1c2244b3e004b22907a1499979681d1"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "52be9533ac9c10ed71828a140374306b"
server_key_iv: "db5d8b61a1635664a588a10b5ac85888"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.416975 25219 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:31.417786 25240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.417974 25219 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:31.418090 25219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "d1c2244b3e004b22907a1499979681d1"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "52be9533ac9c10ed71828a140374306b"
server_key_iv: "db5d8b61a1635664a588a10b5ac85888"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.418169 25219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:31.449401 25219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:31.452023 25219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:31.452209 25219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:31.456614 25219 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:46563
I20260809 18:56:31.456671 25323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:46563 every 8 connection(s)
I20260809 18:56:31.457075 25219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:31.457526 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25219
I20260809 18:56:31.457628 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:31.457813 24468 external_mini_cluster.cc:1428] Setting key 7894bf1986b63ac75ba8a03e295e1a41
I20260809 18:56:31.458236 25324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:31.461287 25324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1: Bootstrap starting.
I20260809 18:56:31.461942 25324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:31.462271 25324 log.cc:824] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:31.462971 25324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1: No bootstrap required, opened a new log
Aug 09 18:56:31 dist-test-slave-jq4t krb5kdc[25199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:31.465739 25324 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1c2244b3e004b22907a1499979681d1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46563 } }
I20260809 18:56:31.465906 25324 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:31.465963 25324 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c2244b3e004b22907a1499979681d1, State: Initialized, Role: FOLLOWER
I20260809 18:56:31.466141 25324 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1c2244b3e004b22907a1499979681d1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46563 } }
I20260809 18:56:31.466243 25324 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:31.466289 25324 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:31.466341 25324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:31.466886 25324 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1c2244b3e004b22907a1499979681d1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46563 } }
I20260809 18:56:31.467020 25324 leader_election.cc:302] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1c2244b3e004b22907a1499979681d1; no voters:
I20260809 18:56:31.467193 25324 leader_election.cc:288] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:31.467270 25331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:31.467458 25331 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [term 1 LEADER]: Becoming Leader. State: Replica: d1c2244b3e004b22907a1499979681d1, State: Running, Role: LEADER
I20260809 18:56:31.467507 25324 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:31.467559 25331 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1c2244b3e004b22907a1499979681d1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46563 } }
I20260809 18:56:31.467912 25331 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1c2244b3e004b22907a1499979681d1. Latest consensus state: current_term: 1 leader_uuid: "d1c2244b3e004b22907a1499979681d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1c2244b3e004b22907a1499979681d1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46563 } } }
I20260809 18:56:31.468010 25331 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:31.467923 25332 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1c2244b3e004b22907a1499979681d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1c2244b3e004b22907a1499979681d1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46563 } } }
I20260809 18:56:31.468060 25332 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:31.468923 25341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:31.469614 25341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:31.469676 25327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.458439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38006 (local address 127.23.229.62:46563)
0809 18:56:31.458625 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:31.458634 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:31.458672 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:56:31.459372 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:31.459382 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:31.459437 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:31.459620 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:31.460285 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.461280 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.462066 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.462556 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.462690 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.465471 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:31.465476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:31.465476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:31.465487 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:31.467470 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.467959 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.467962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.467962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.468102 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.468368 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.468369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.468369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.468751 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:31.469357 (+ 606us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:31.469418 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 18:56:31.469528 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
I20260809 18:56:31.471591 25341 catalog_manager.cc:1347] Generated new cluster ID: d846e44c4007470fa44a55e17245513a
I20260809 18:56:31.471650 25341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:31.492223 25341 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:31.493077 25341 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:31.502617 25341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1c2244b3e004b22907a1499979681d1: Generated new TSK 0
I20260809 18:56:31.502863 25341 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:31.532006 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46563
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:31.625396 25361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:31.625658 25361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:31.625703 25361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:31.626899 25361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:31.626979 25361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:31.627027 25361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:31.628782 25361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46563
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:31.629078 25361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:31.629343 25361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:31.634859 25369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:31.634871 25371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:31.634871 25373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:31.634918 25361 server_base.cc:1034] running on GCE node
I20260809 18:56:31.635286 25361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:31.635541 25361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:31.636693 25361 hybrid_clock.cc:648] HybridClock initialized: now 1786301791636681 us; error 35 us; skew 500 ppm
Aug 09 18:56:31 dist-test-slave-jq4t krb5kdc[25199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:31.639518 25361 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:31.639997 25361 webserver.cc:460] Webserver started at http://127.23.229.1:35565/ using document root <none> and password file <none>
I20260809 18:56:31.640234 25361 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:31.640280 25361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:31.640442 25361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:31.641577 25361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "54776a66c20b4e15bef01f188b0a3ccc"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "960f23dc175ae04d279a85a0dd00def1"
server_key_iv: "4f009d2fb8bdfc31b85ea2117eb6afab"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.641960 25361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "54776a66c20b4e15bef01f188b0a3ccc"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "960f23dc175ae04d279a85a0dd00def1"
server_key_iv: "4f009d2fb8bdfc31b85ea2117eb6afab"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.643383 25361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:31.644173 25387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.644383 25361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:31.644515 25361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "54776a66c20b4e15bef01f188b0a3ccc"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "960f23dc175ae04d279a85a0dd00def1"
server_key_iv: "4f009d2fb8bdfc31b85ea2117eb6afab"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.644608 25361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:31.658851 25361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:31.661185 25361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:31.661375 25361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:31.661639 25361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:31.661988 25361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:31.662047 25361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.662086 25361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:31.662133 25361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.668732 25361 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:34589
I20260809 18:56:31.668812 25550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:34589 every 8 connection(s)
I20260809 18:56:31.669224 25361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:56:31 dist-test-slave-jq4t krb5kdc[25199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:31.678953 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25361
I20260809 18:56:31.679052 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:31.679239 24468 external_mini_cluster.cc:1428] Setting key bc2509f63d70ca670db0af8af72af4db
I20260809 18:56:31.679450 25327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.670060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:40431 (local address 127.23.229.62:46563)
0809 18:56:31.670112 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:31.670114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:31.670331 (+ 217us) server_negotiation.cc:407] Connection header received
0809 18:56:31.671500 (+ 1169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:31.671501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:31.671513 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:31.671579 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:31.672205 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.672739 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.673743 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.673975 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.674037 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.676267 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:31.676270 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:31.676270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:31.676286 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:31.677835 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.678301 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.678304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.678305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.678367 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.678646 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.678647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.678647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.678819 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:31.678895 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:31.679233 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 18:56:31.679349 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:56:31.679667 25554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.670006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:46563 (local address 127.23.229.1:40431)
0809 18:56:31.670175 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:31.670221 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:31.671376 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:31.671635 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:31.671638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:31.671900 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:31.672110 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:31.672115 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.672823 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.672824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:31.673658 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:31.673660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.674056 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.674057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:31.674159 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.674671 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:31.674680 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:31.676152 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:31.677946 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:31.677955 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:31.677957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:31.678206 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:31.678446 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:31.678446 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:31.678447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:31.678568 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:31.678902 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:31.678909 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:31.679079 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 18:56:31.679200 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 18:56:31.679398 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260809 18:56:31.680202 25551 heartbeater.cc:347] Connected to a master server at 127.23.229.62:46563
I20260809 18:56:31.680328 25551 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:31.680573 25551 heartbeater.cc:511] Master 127.23.229.62:46563 requested a full tablet report, sending...
I20260809 18:56:31.681162 25267 ts_manager.cc:194] Registered new tserver with Master: 54776a66c20b4e15bef01f188b0a3ccc (127.23.229.1:34589)
I20260809 18:56:31.681810 25267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:40431
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:31.705819 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46563
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:31.792861 25560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:31.793121 25560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:31.793162 25560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:31.794334 25560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:31.794402 25560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:31.794445 25560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:31.795960 25560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46563
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:31.796236 25560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:31.796504 25560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:31.801765 25569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:31.801751 25571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:31.801751 25568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:31.802037 25560 server_base.cc:1034] running on GCE node
I20260809 18:56:31.802299 25560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:31.802551 25560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:31.803721 25560 hybrid_clock.cc:648] HybridClock initialized: now 1786301791803709 us; error 31 us; skew 500 ppm
Aug 09 18:56:31 dist-test-slave-jq4t krb5kdc[25199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:31.806517 25560 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:31.806999 25560 webserver.cc:460] Webserver started at http://127.23.229.2:35655/ using document root <none> and password file <none>
I20260809 18:56:31.807236 25560 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:31.807307 25560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:31.807468 25560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:31.808635 25560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "8b7ab2d55b8c4af3904c67e89872a365"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "4388f44337688003bd43c036d01c8519"
server_key_iv: "61fec41f94c43431bbad9791b7064c00"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.809016 25560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "8b7ab2d55b8c4af3904c67e89872a365"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "4388f44337688003bd43c036d01c8519"
server_key_iv: "61fec41f94c43431bbad9791b7064c00"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.810353 25560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:56:31.811086 25582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.811259 25560 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:31.811365 25560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "8b7ab2d55b8c4af3904c67e89872a365"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-jq4t"
server_key: "4388f44337688003bd43c036d01c8519"
server_key_iv: "61fec41f94c43431bbad9791b7064c00"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.811450 25560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:31.859393 25560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:31.862187 25560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:31.862365 25560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:31.862632 25560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:31.863000 25560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:31.863056 25560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.863093 25560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:31.863140 25560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.869668 25560 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:43415
I20260809 18:56:31.869714 25747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:43415 every 8 connection(s)
I20260809 18:56:31.870074 25560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:31.872300 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25560
I20260809 18:56:31.872421 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:31.872622 24468 external_mini_cluster.cc:1428] Setting key 69a2de691d42aa299769ea1cfa36af33
Aug 09 18:56:31 dist-test-slave-jq4t krb5kdc[25199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
I20260809 18:56:31.886689 25327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.870868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:47387 (local address 127.23.229.62:46563)
0809 18:56:31.870924 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:31.870927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:31.871120 (+ 193us) server_negotiation.cc:407] Connection header received
0809 18:56:31.872123 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:31.872124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:31.872137 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:31.872235 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:31.873192 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.873972 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.875296 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.875632 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.875709 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.879103 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:31.879105 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:31.879105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:31.879114 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:31.881069 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.881662 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.881663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.881664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.881740 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.884364 (+ 2624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.884366 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.884366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.884604 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:31.884695 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:31.886433 (+ 1738us) server_negotiation.cc:299] Negotiation successful
0809 18:56:31.886551 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:56:31.886845 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.870825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:46563 (local address 127.23.229.2:47387)
0809 18:56:31.870998 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:31.871042 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:31.872008 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:31.872334 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:31.872338 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:31.872762 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:31.873098 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:31.873105 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.874072 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.874073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:31.875186 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:31.875190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.875788 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.875789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:31.875951 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.876799 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:31.876816 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:31.878954 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:31.881188 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:31.881198 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:31.881202 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:31.881565 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:31.881838 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:31.881839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:31.881839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:31.882038 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:31.886037 (+ 3999us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:31.886051 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:31.886244 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 18:56:31.886395 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 18:56:31.886600 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260809 18:56:31.887583 25748 heartbeater.cc:347] Connected to a master server at 127.23.229.62:46563
I20260809 18:56:31.887712 25748 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:31.887946 25748 heartbeater.cc:511] Master 127.23.229.62:46563 requested a full tablet report, sending...
I20260809 18:56:31.888456 25267 ts_manager.cc:194] Registered new tserver with Master: 8b7ab2d55b8c4af3904c67e89872a365 (127.23.229.2:43415)
I20260809 18:56:31.888993 25267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:47387
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:31.905676 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46563
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:31.991812 25754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:31.992076 25754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:31.992121 25754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:31.993409 25754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:31.993481 25754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:31.993527 25754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:31.995083 25754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46563
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:31.995365 25754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:31.995630 25754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:32.001348 25769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:32.001356 25766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:32.001384 25767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:32.001693 25754 server_base.cc:1034] running on GCE node
I20260809 18:56:32.001984 25754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:32.002238 25754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:32.003430 25754 hybrid_clock.cc:648] HybridClock initialized: now 1786301792003463 us; error 115 us; skew 500 ppm
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:32.006560 25754 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:32.007082 25754 webserver.cc:460] Webserver started at http://127.23.229.3:36619/ using document root <none> and password file <none>
I20260809 18:56:32.007375 25754 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:32.007458 25754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:32.007615 25754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:32.008841 25754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "46439b5f5cfd478bab30505980dc5c34"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-jq4t"
server_key: "56d1f05d4f324b3713efe0e9e5c90943"
server_key_iv: "d169a53b9901f27a7409415a3ed92168"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.009241 25754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "46439b5f5cfd478bab30505980dc5c34"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-jq4t"
server_key: "56d1f05d4f324b3713efe0e9e5c90943"
server_key_iv: "d169a53b9901f27a7409415a3ed92168"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.010794 25754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:56:32.011675 25779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.011845 25754 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:32.011960 25754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "46439b5f5cfd478bab30505980dc5c34"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-jq4t"
server_key: "56d1f05d4f324b3713efe0e9e5c90943"
server_key_iv: "d169a53b9901f27a7409415a3ed92168"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.012039 25754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:32.022557 25754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:32.025058 25754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:32.025234 25754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:32.025502 25754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:32.025841 25754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:32.025897 25754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.025934 25754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:32.025979 25754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.031919 25754 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:40907
I20260809 18:56:32.032011 25934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:40907 every 8 connection(s)
I20260809 18:56:32.032356 25754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:32.041882 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25754
I20260809 18:56:32.041967 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:32.042145 24468 external_mini_cluster.cc:1428] Setting key 7cfbda776518611d39c5cac3cfe32369
I20260809 18:56:32.042418 25327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.033238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:33087 (local address 127.23.229.62:46563)
0809 18:56:32.033290 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.033292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.033511 (+ 219us) server_negotiation.cc:407] Connection header received
0809 18:56:32.034482 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.034483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.034495 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.034553 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.035193 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.035718 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.036755 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.036974 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.037036 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.039206 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:32.039207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:32.039207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:32.039215 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:32.040789 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.041204 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.041205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.041206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.041262 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.041498 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.041498 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.041499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.041616 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:32.041669 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.042220 (+ 551us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.042322 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:56:32.042680 25938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.033203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:46563 (local address 127.23.229.3:33087)
0809 18:56:32.033366 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.033403 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.034382 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.034611 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.034615 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.034889 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:32.035089 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.035093 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.035807 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.035807 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.036677 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.036679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.037053 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.037054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.037154 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.037655 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:32.037664 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:32.039081 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:32.040870 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:32.040877 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:32.040880 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:32.041128 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:32.041332 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:32.041333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:32.041333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:32.041441 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:32.041675 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:32.041680 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:32.042030 (+ 350us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.042175 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.042398 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
I20260809 18:56:32.043213 25935 heartbeater.cc:347] Connected to a master server at 127.23.229.62:46563
I20260809 18:56:32.043341 25935 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:32.043540 25935 heartbeater.cc:511] Master 127.23.229.62:46563 requested a full tablet report, sending...
I20260809 18:56:32.043993 25267 ts_manager.cc:194] Registered new tserver with Master: 46439b5f5cfd478bab30505980dc5c34 (127.23.229.3:40907)
I20260809 18:56:32.044360 25267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:33087
I20260809 18:56:32.054483 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:56:32.062703 25327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.056254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.23.229.62:46563)
0809 18:56:32.056332 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.056334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.056450 (+ 116us) server_negotiation.cc:407] Connection header received
0809 18:56:32.056531 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.056535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.056547 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.056602 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.057183 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.057698 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.058417 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.058610 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.058661 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.060017 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:32.060018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:32.060019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:32.060026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:32.061645 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.061995 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.061996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.061996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.062055 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.062229 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.062230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.062231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.062397 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:32.062486 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.062567 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.062630 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:56:32.065318 25267 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:32.067224 25267 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:32.074028 25953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.069871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:40907 (local address 127.0.0.1:37344)
0809 18:56:32.070096 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.070140 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.070210 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.070624 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.070625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.070627 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:32.070663 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.070664 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.071665 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.071666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.072877 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.072880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.073720 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.073721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.073805 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.073819 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.073890 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.073946 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":47,"threads_started":1}
I20260809 18:56:32.074038 25955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.070076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37344 (local address 127.23.229.3:40907)
0809 18:56:32.070397 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.070400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.070408 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:32.070439 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.070440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.070452 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.070545 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:32.070736 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.071561 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.072976 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.073628 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.073718 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.073783 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.073910 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.073948 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":98,"threads_started":1}
I20260809 18:56:32.074535 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.070190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48978 (local address 127.23.229.1:34589)
0809 18:56:32.070388 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.070392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.070590 (+ 198us) server_negotiation.cc:407] Connection header received
0809 18:56:32.070640 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.070642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.070658 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.070831 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:32.071062 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.072108 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.073280 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.074027 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.074105 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.074173 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.074406 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.074453 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":89,"threads_started":1}
I20260809 18:56:32.074530 25954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.069880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34589 (local address 127.0.0.1:48978)
0809 18:56:32.070464 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.070475 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.070529 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.070907 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.070907 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.070909 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:32.070960 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.070961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.072187 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.072189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.073186 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.073188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.074218 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.074219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.074307 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.074312 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.074369 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.074417 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":118,"threads_started":1}
I20260809 18:56:32.074532 25952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.069865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:43415 (local address 127.0.0.1:33336)
0809 18:56:32.070229 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.070239 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.070281 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.070526 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.070529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.070532 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:32.070614 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.070616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.072129 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.072130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.073287 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.073290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.074311 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.074312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.074372 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.074377 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.074406 (+ 29us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.074434 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":59,"thread_start_us":99,"threads_started":1}
I20260809 18:56:32.075049 25848 tablet_service.cc:1467] Processing CreateTablet for tablet 8b10e3c75c8246a8953896bfe2e2cc0e (DEFAULT_TABLE table=test-table [id=14dc96764c1e46439a43d7ef6f6d0399]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:32.075452 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.070116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33336 (local address 127.23.229.2:43415)
0809 18:56:32.070314 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.070320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.070332 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:56:32.070379 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.070381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.070400 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.070504 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:32.070699 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.072001 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.073380 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.074065 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.074569 (+ 504us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.075230 (+ 661us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.075308 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.075359 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":81,"threads_started":1}
I20260809 18:56:32.075467 25848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b10e3c75c8246a8953896bfe2e2cc0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:32.075341 25453 tablet_service.cc:1467] Processing CreateTablet for tablet 8b10e3c75c8246a8953896bfe2e2cc0e (DEFAULT_TABLE table=test-table [id=14dc96764c1e46439a43d7ef6f6d0399]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:32.075769 25453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b10e3c75c8246a8953896bfe2e2cc0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:32.076236 25653 tablet_service.cc:1467] Processing CreateTablet for tablet 8b10e3c75c8246a8953896bfe2e2cc0e (DEFAULT_TABLE table=test-table [id=14dc96764c1e46439a43d7ef6f6d0399]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:32.076572 25653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b10e3c75c8246a8953896bfe2e2cc0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:32.079411 25963 tablet_bootstrap.cc:492] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc: Bootstrap starting.
I20260809 18:56:32.079927 25965 tablet_bootstrap.cc:492] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365: Bootstrap starting.
I20260809 18:56:32.080041 25963 tablet_bootstrap.cc:654] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:32.080400 25960 tablet_bootstrap.cc:492] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34: Bootstrap starting.
I20260809 18:56:32.080621 25963 log.cc:824] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:32.080658 25965 tablet_bootstrap.cc:654] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:32.081177 25960 tablet_bootstrap.cc:654] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:32.081233 25965 log.cc:824] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:32.081473 25963 tablet_bootstrap.cc:492] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc: No bootstrap required, opened a new log
I20260809 18:56:32.081542 25963 ts_tablet_manager.cc:1397] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:56:32.081756 25960 log.cc:824] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:32.082065 25965 tablet_bootstrap.cc:492] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365: No bootstrap required, opened a new log
I20260809 18:56:32.082178 25965 ts_tablet_manager.cc:1397] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:32.082679 25960 tablet_bootstrap.cc:492] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34: No bootstrap required, opened a new log
I20260809 18:56:32.082868 25960 ts_tablet_manager.cc:1397] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:32.083329 25963 raft_consensus.cc:348] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.083516 25963 raft_consensus.cc:374] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:32.083564 25963 raft_consensus.cc:729] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54776a66c20b4e15bef01f188b0a3ccc, State: Initialized, Role: FOLLOWER
I20260809 18:56:32.083710 25963 consensus_queue.cc:260] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.084005 25963 ts_tablet_manager.cc:1428] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 18:56:32.084149 25551 heartbeater.cc:503] Master 127.23.229.62:46563 was elected leader, sending a full tablet report...
I20260809 18:56:32.084628 25965 raft_consensus.cc:348] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.084818 25965 raft_consensus.cc:374] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:32.084856 25965 raft_consensus.cc:729] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7ab2d55b8c4af3904c67e89872a365, State: Initialized, Role: FOLLOWER
I20260809 18:56:32.084980 25965 consensus_queue.cc:260] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.084954 25960 raft_consensus.cc:348] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.085116 25960 raft_consensus.cc:374] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:32.085157 25960 raft_consensus.cc:729] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46439b5f5cfd478bab30505980dc5c34, State: Initialized, Role: FOLLOWER
I20260809 18:56:32.085268 25965 ts_tablet_manager.cc:1428] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:32.085395 25748 heartbeater.cc:503] Master 127.23.229.62:46563 was elected leader, sending a full tablet report...
I20260809 18:56:32.085337 25960 consensus_queue.cc:260] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.085947 25960 ts_tablet_manager.cc:1428] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:32.086088 25935 heartbeater.cc:503] Master 127.23.229.62:46563 was elected leader, sending a full tablet report...
I20260809 18:56:32.086197 25973 raft_consensus.cc:482] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:32.086400 25973 raft_consensus.cc:504] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.086757 25973 leader_election.cc:288] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7ab2d55b8c4af3904c67e89872a365 (127.23.229.2:43415), 54776a66c20b4e15bef01f188b0a3ccc (127.23.229.1:34589)
I20260809 18:56:32.090812 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.087010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:57831 (local address 127.23.229.2:43415)
0809 18:56:32.087053 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.087055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.087064 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:32.087087 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.087088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.087104 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.087165 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:32.087369 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.088176 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.089769 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.090343 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.090435 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.090444 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.090673 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.090711 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:56:32.090848 25938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.086892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:43415 (local address 127.23.229.3:57831)
0809 18:56:32.086961 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.086976 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.087022 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.087184 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.087186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.087188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:32.087263 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.087266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.088304 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.088306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.089664 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.089667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.090454 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.090455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.090575 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.090579 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.090648 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.090704 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":62}
I20260809 18:56:32.091361 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.087119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:52625 (local address 127.23.229.1:34589)
0809 18:56:32.087230 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.087232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.087365 (+ 133us) server_negotiation.cc:407] Connection header received
0809 18:56:32.087406 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.087407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.087418 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.087478 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:32.087550 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.088235 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.089769 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.090343 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.090422 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.090433 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.091236 (+ 803us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.091284 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 18:56:32.091576 25975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.086936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34589 (local address 127.23.229.3:52625)
0809 18:56:32.087287 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.087298 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.087354 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.087468 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.087468 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.087469 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:32.087513 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.087513 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.088313 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.088314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.089666 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.089667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.091057 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.091058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.091136 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.091141 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.091456 (+ 315us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.091507 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":75,"thread_start_us":95,"threads_started":1}
I20260809 18:56:32.091559 25680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b10e3c75c8246a8953896bfe2e2cc0e" candidate_uuid: "46439b5f5cfd478bab30505980dc5c34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7ab2d55b8c4af3904c67e89872a365" is_pre_election: true
I20260809 18:56:32.091722 25680 raft_consensus.cc:2454] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46439b5f5cfd478bab30505980dc5c34 in term 0.
I20260809 18:56:32.091948 25780 leader_election.cc:302] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46439b5f5cfd478bab30505980dc5c34, 8b7ab2d55b8c4af3904c67e89872a365; no voters:
I20260809 18:56:32.091903 25482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b10e3c75c8246a8953896bfe2e2cc0e" candidate_uuid: "46439b5f5cfd478bab30505980dc5c34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54776a66c20b4e15bef01f188b0a3ccc" is_pre_election: true
I20260809 18:56:32.092072 25482 raft_consensus.cc:2454] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46439b5f5cfd478bab30505980dc5c34 in term 0.
I20260809 18:56:32.092162 25973 raft_consensus.cc:2781] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:32.092247 25973 raft_consensus.cc:482] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:32.092276 25973 raft_consensus.cc:3037] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:32.093068 25973 raft_consensus.cc:504] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.093225 25973 leader_election.cc:288] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7ab2d55b8c4af3904c67e89872a365 (127.23.229.2:43415), 54776a66c20b4e15bef01f188b0a3ccc (127.23.229.1:34589)
I20260809 18:56:32.093389 25680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b10e3c75c8246a8953896bfe2e2cc0e" candidate_uuid: "46439b5f5cfd478bab30505980dc5c34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7ab2d55b8c4af3904c67e89872a365"
I20260809 18:56:32.093389 25482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b10e3c75c8246a8953896bfe2e2cc0e" candidate_uuid: "46439b5f5cfd478bab30505980dc5c34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54776a66c20b4e15bef01f188b0a3ccc"
I20260809 18:56:32.093472 25680 raft_consensus.cc:3037] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:32.093472 25482 raft_consensus.cc:3037] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:32.094383 25680 raft_consensus.cc:2454] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46439b5f5cfd478bab30505980dc5c34 in term 1.
I20260809 18:56:32.094393 25482 raft_consensus.cc:2454] T 8b10e3c75c8246a8953896bfe2e2cc0e P 54776a66c20b4e15bef01f188b0a3ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46439b5f5cfd478bab30505980dc5c34 in term 1.
I20260809 18:56:32.094622 25780 leader_election.cc:302] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46439b5f5cfd478bab30505980dc5c34, 8b7ab2d55b8c4af3904c67e89872a365; no voters:
I20260809 18:56:32.094735 25973 raft_consensus.cc:2781] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:32.094797 25973 raft_consensus.cc:686] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [term 1 LEADER]: Becoming Leader. State: Replica: 46439b5f5cfd478bab30505980dc5c34, State: Running, Role: LEADER
I20260809 18:56:32.094916 25973 consensus_queue.cc:237] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } }
I20260809 18:56:32.095989 25265 catalog_manager.cc:5495] T 8b10e3c75c8246a8953896bfe2e2cc0e P 46439b5f5cfd478bab30505980dc5c34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46439b5f5cfd478bab30505980dc5c34 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "46439b5f5cfd478bab30505980dc5c34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46439b5f5cfd478bab30505980dc5c34" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b7ab2d55b8c4af3904c67e89872a365" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 43415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54776a66c20b4e15bef01f188b0a3ccc" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34589 } health_report { overall_health: UNKNOWN } } }
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:32.107023 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.098690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48990 (local address 127.23.229.1:34589)
0809 18:56:32.098764 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.098767 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.098867 (+ 100us) server_negotiation.cc:407] Connection header received
0809 18:56:32.098951 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.098952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.098962 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.099038 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.099626 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.100147 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.100970 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.101177 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.101254 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.103878 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:32.103891 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:32.103892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:32.103900 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:32.105764 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.106182 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.106187 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.106187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.106251 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.106467 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.106468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.106468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.106638 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:32.106752 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.106881 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.106949 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260809 18:56:32.120669 25749 tablet.cc:2369] T 8b10e3c75c8246a8953896bfe2e2cc0e P 8b7ab2d55b8c4af3904c67e89872a365: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:32.132750 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.125370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.23.229.1:34589)
0809 18:56:32.125435 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.125437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.125476 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:56:32.125562 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.125563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.125573 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.125627 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.126210 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.126729 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.127475 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.127684 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.127742 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.130209 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:32.130211 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:32.130212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:32.130219 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:32.131515 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.131840 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.131840 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.131841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.131894 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.132127 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.132128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.132128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.132229 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:32.132303 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.132550 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.132635 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:32.157900 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.150597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49014 (local address 127.23.229.1:34589)
0809 18:56:32.150672 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.150674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.150716 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:56:32.150778 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.150779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.150790 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.150857 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.151420 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.151913 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.152736 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.152942 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.153005 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.155329 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:32.155331 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:32.155331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:32.155338 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:32.156829 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.157152 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.157153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.157153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.157208 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.157403 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.157405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.157405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.157525 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:32.157613 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.157700 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.157766 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 18:56:32.158492 25428 tablet_service.cc:2908] Rejecting scan request for tablet 8b10e3c75c8246a8953896bfe2e2cc0e: Uninitialized: clean time has not yet been initialized
I20260809 18:56:32.159734 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25361
I20260809 18:56:32.173233 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25560
I20260809 18:56:32.185024 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25754
I20260809 18:56:32.194730 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25219
2026-08-09T18:56:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2252 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25996](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25996](info): set up 2 sockets
Aug 09 18:56:32 dist-test-slave-jq4t krb5kdc[25996](info): commencing operation
krb5kdc: starting...
W20260809 18:56:33.447043 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:33 dist-test-slave-jq4t krb5kdc[25996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:33.571148 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40923
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:40923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:33.658005 26011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:33.658306 26011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:33.658353 26011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:33.659595 26011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:33.659677 26011 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:56:33.659700 26011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:33.659722 26011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:33.659755 26011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:33.659780 26011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:33.661474 26011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:40923
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:33.661793 26011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:33.662066 26011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:33.667433 26017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:33.667459 26020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:33.667449 26016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:33.667699 26011 server_base.cc:1034] running on GCE node
I20260809 18:56:33.668061 26011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:33.668390 26011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:33.669541 26011 hybrid_clock.cc:648] HybridClock initialized: now 1786301793669531 us; error 31 us; skew 500 ppm
Aug 09 18:56:33 dist-test-slave-jq4t krb5kdc[25996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301793, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:33.672288 26011 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:33.672789 26011 webserver.cc:460] Webserver started at http://127.23.229.62:42937/ using document root <none> and password file <none>
I20260809 18:56:33.673059 26011 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:33.673130 26011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:33.673285 26011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:33.674374 26011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "e6f2989d3d0a4901b96271b5d3e62d60"
format_stamp: "Formatted at 2026-08-09 18:56:33 on dist-test-slave-jq4t"
server_key: "4a1b2bae6e6d51b1eead760b7430aa1b"
server_key_iv: "45b812320e795f88e9ea4b5e092308f5"
server_key_version: "encryptionkey@0"
I20260809 18:56:33.674764 26011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "e6f2989d3d0a4901b96271b5d3e62d60"
format_stamp: "Formatted at 2026-08-09 18:56:33 on dist-test-slave-jq4t"
server_key: "4a1b2bae6e6d51b1eead760b7430aa1b"
server_key_iv: "45b812320e795f88e9ea4b5e092308f5"
server_key_version: "encryptionkey@0"
I20260809 18:56:33.676180 26011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:33.677030 26029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:33.677210 26011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:56:33.677326 26011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "e6f2989d3d0a4901b96271b5d3e62d60"
format_stamp: "Formatted at 2026-08-09 18:56:33 on dist-test-slave-jq4t"
server_key: "4a1b2bae6e6d51b1eead760b7430aa1b"
server_key_iv: "45b812320e795f88e9ea4b5e092308f5"
server_key_version: "encryptionkey@0"
I20260809 18:56:33.677408 26011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:33.690972 26011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:33.693264 26011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:33.693445 26011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:33.698707 26011 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:40923
I20260809 18:56:33.698772 26115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:40923 every 8 connection(s)
I20260809 18:56:33.699131 26011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:33.699808 26116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:33.702286 26116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: Bootstrap starting.
I20260809 18:56:33.702935 26116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:33.703258 26116 log.cc:824] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:33.704071 26116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: No bootstrap required, opened a new log
I20260809 18:56:33.706447 26116 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } }
I20260809 18:56:33.706607 26116 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:33.706631 26116 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f2989d3d0a4901b96271b5d3e62d60, State: Initialized, Role: FOLLOWER
I20260809 18:56:33.706791 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26011
I20260809 18:56:33.706804 26116 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } }
I20260809 18:56:33.706894 26116 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:33.706923 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:33.706943 26116 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:33.707011 26116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:33.707145 24468 external_mini_cluster.cc:1428] Setting key 6031018444477b9bc4875c215e1a8031
I20260809 18:56:33.707882 26116 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } }
I20260809 18:56:33.708015 26116 leader_election.cc:302] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6f2989d3d0a4901b96271b5d3e62d60; no voters:
I20260809 18:56:33.708225 26116 leader_election.cc:288] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:33.708249 26126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:33.708369 26126 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [term 1 LEADER]: Becoming Leader. State: Replica: e6f2989d3d0a4901b96271b5d3e62d60, State: Running, Role: LEADER
I20260809 18:56:33.708468 26126 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } }
I20260809 18:56:33.708542 26116 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:33.708861 26128 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } }
I20260809 18:56:33.708956 26128 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:33.708865 26127 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6f2989d3d0a4901b96271b5d3e62d60. Latest consensus state: current_term: 1 leader_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f2989d3d0a4901b96271b5d3e62d60" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } }
I20260809 18:56:33.709160 26127 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60 [sys.catalog]: This master's current role is: LEADER
W20260809 18:56:33.710441 26148 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:56:33.710515 26148 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:33.710562 26132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:33.710714 26132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:33.712344 26132 catalog_manager.cc:1347] Generated new cluster ID: e681433ea2bb44d1973a53c6a736bb18
I20260809 18:56:33.712399 26132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:56:33 dist-test-slave-jq4t krb5kdc[25996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:33.720346 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:33.707722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37790 (local address 127.23.229.62:40923)
0809 18:56:33.707920 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:33.707930 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:33.707970 (+ 40us) server_negotiation.cc:407] Connection header received
0809 18:56:33.708117 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:33.708126 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:33.708189 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:33.709234 (+ 1045us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:33.709356 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.710728 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.711686 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.712299 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.712424 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:33.715494 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:33.715498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:33.715499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:33.715512 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:33.718520 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:33.718940 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:33.718944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:33.718945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:33.719083 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:33.719302 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:33.719303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:33.719303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:33.719651 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:33.719877 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:33.719956 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 18:56:33.720110 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":114,"threads_started":1}
I20260809 18:56:33.722462 26132 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:33.722993 26132 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:33.725801 26132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: Generated new TSK 0
I20260809 18:56:33.725998 26132 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:33.757125 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40923
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:33.844215 26156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:33.844424 26156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:33.844448 26156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:33.845677 26156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:33.845722 26156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:33.845743 26156 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:33.845804 26156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:33.847289 26156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:40923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:33.847550 26156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:33.847795 26156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:33.852969 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:33.852975 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:33.852965 26168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:33.853343 26156 server_base.cc:1034] running on GCE node
I20260809 18:56:33.853595 26156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:33.853885 26156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:33.855047 26156 hybrid_clock.cc:648] HybridClock initialized: now 1786301793855016 us; error 45 us; skew 500 ppm
Aug 09 18:56:33 dist-test-slave-jq4t krb5kdc[25996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301793, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:33.857833 26156 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:33.858304 26156 webserver.cc:460] Webserver started at http://127.23.229.1:38695/ using document root <none> and password file <none>
I20260809 18:56:33.858572 26156 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:33.858644 26156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:33.858803 26156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:33.859898 26156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "a1ff43129a634ff096728a1c30bc7ee5"
format_stamp: "Formatted at 2026-08-09 18:56:33 on dist-test-slave-jq4t"
server_key: "c8adee9f2905b5372bbdb03215cc235e"
server_key_iv: "e1b8107558823bf4649088bca710dd23"
server_key_version: "encryptionkey@0"
I20260809 18:56:33.860282 26156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "a1ff43129a634ff096728a1c30bc7ee5"
format_stamp: "Formatted at 2026-08-09 18:56:33 on dist-test-slave-jq4t"
server_key: "c8adee9f2905b5372bbdb03215cc235e"
server_key_iv: "e1b8107558823bf4649088bca710dd23"
server_key_version: "encryptionkey@0"
I20260809 18:56:33.861709 26156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:33.862501 26180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:33.862701 26156 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:33.862795 26156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "a1ff43129a634ff096728a1c30bc7ee5"
format_stamp: "Formatted at 2026-08-09 18:56:33 on dist-test-slave-jq4t"
server_key: "c8adee9f2905b5372bbdb03215cc235e"
server_key_iv: "e1b8107558823bf4649088bca710dd23"
server_key_version: "encryptionkey@0"
I20260809 18:56:33.862885 26156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:33.870741 26156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:33.872638 26156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:33.872812 26156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:33.873318 26156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:33.873359 26156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:33.873383 26156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:33.873396 26156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:33.880818 26156 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:41045
I20260809 18:56:33.880910 26374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:41045 every 8 connection(s)
Aug 09 18:56:33 dist-test-slave-jq4t krb5kdc[25996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301793, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:33.881230 26156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:33.883201 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26156
I20260809 18:56:33.883347 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:33.883530 24468 external_mini_cluster.cc:1428] Setting key e287c4b5032f9f1d01979a183fe60974
I20260809 18:56:33.884761 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:33.873894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:60147 (local address 127.23.229.62:40923)
0809 18:56:33.873955 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:33.873957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:33.874192 (+ 235us) server_negotiation.cc:407] Connection header received
0809 18:56:33.874772 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:33.874774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:33.874789 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:33.874865 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:33.875582 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.876410 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.878156 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.878530 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.878602 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:33.881515 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:33.881518 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:33.881518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:33.881531 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:33.883111 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:33.883625 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:33.883626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:33.883627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:33.883714 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:33.884031 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:33.884032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:33.884032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:33.884173 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:33.884245 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:33.884620 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 18:56:33.884697 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:56:33.885062 26193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:33.873893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.23.229.1:60147)
0809 18:56:33.874072 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:33.874107 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:33.874610 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:33.874964 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:33.874968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:33.875284 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:33.875476 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:33.875481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.876546 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.876547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:33.878033 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:33.878037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.878623 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.878624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:33.878778 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:33.879397 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:33.879407 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:33.881408 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:33.883222 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:33.883230 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:33.883233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:33.883536 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:33.883776 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:33.883778 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:33.883778 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:33.883946 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:33.884249 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:33.884256 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:33.884427 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 18:56:33.884597 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 18:56:33.884784 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260809 18:56:33.885571 26378 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40923
I20260809 18:56:33.885658 26378 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:33.885851 26378 heartbeater.cc:511] Master 127.23.229.62:40923 requested a full tablet report, sending...
I20260809 18:56:33.886469 26050 ts_manager.cc:194] Registered new tserver with Master: a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1:41045)
I20260809 18:56:33.887435 26050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:60147
I20260809 18:56:33.892843 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:33.886606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:48461 (local address 127.23.229.62:40923)
0809 18:56:33.886652 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:33.886654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:33.886827 (+ 173us) server_negotiation.cc:407] Connection header received
0809 18:56:33.886881 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:33.886882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:33.886891 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:33.886936 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:33.887317 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.887863 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.888849 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.889066 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.889152 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:33.890144 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:33.890146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:33.890146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:33.890153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:33.891670 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:33.892019 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:33.892020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:33.892021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:33.892079 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:33.892288 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:33.892289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:33.892289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:33.892406 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:33.892484 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:33.892677 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 18:56:33.892757 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:56:33.892845 26386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:33.886610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.23.229.1:48461)
0809 18:56:33.886746 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:33.886758 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:33.886825 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:33.886950 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:33.886951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:33.887162 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:33.887224 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:33.887226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.887994 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.887995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:33.888753 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:33.888756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:33.889182 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:33.889183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:33.889259 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:33.889739 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:33.889743 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:33.890035 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:33.891756 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:33.891757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:33.891757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:33.891941 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:33.892159 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:33.892160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:33.892160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:33.892224 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:33.892509 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:33.892510 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:33.892557 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:56:33.892637 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:56:33.892746 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":24,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:33.912792 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40923
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:33.999225 26388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:33.999466 26388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:33.999493 26388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:34.000731 26388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:34.000778 26388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:34.000800 26388 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:34.000855 26388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:34.002372 26388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:40923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:34.002648 26388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:34.002897 26388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:34.008354 26396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:34.008328 26402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:34.008328 26398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:34.008406 26388 server_base.cc:1034] running on GCE node
I20260809 18:56:34.008882 26388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:34.009109 26388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:34.010281 26388 hybrid_clock.cc:648] HybridClock initialized: now 1786301794010274 us; error 38 us; skew 500 ppm
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:34.012929 26388 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:34.013320 26388 webserver.cc:460] Webserver started at http://127.23.229.2:33677/ using document root <none> and password file <none>
I20260809 18:56:34.013532 26388 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:34.013581 26388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:34.013675 26388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:34.014753 26388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "e4d7f4ca8ce440c49ab818e512193045"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-jq4t"
server_key: "b7984e238f70dd652170bf5483ae4731"
server_key_iv: "84bc73b4007143047bf3f05055642ff9"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.015074 26388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "e4d7f4ca8ce440c49ab818e512193045"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-jq4t"
server_key: "b7984e238f70dd652170bf5483ae4731"
server_key_iv: "84bc73b4007143047bf3f05055642ff9"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.016433 26388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 18:56:34.017251 26411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.017431 26388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:34.017526 26388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "e4d7f4ca8ce440c49ab818e512193045"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-jq4t"
server_key: "b7984e238f70dd652170bf5483ae4731"
server_key_iv: "84bc73b4007143047bf3f05055642ff9"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.017586 26388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:34.027740 26388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:34.029997 26388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:34.030177 26388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:34.030719 26388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:34.030786 26388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.030843 26388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:34.030870 26388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.037585 26388 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:32925
I20260809 18:56:34.037699 26589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:32925 every 8 connection(s)
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:34.038018 26388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:34.038735 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26388
I20260809 18:56:34.038839 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:34.039036 24468 external_mini_cluster.cc:1428] Setting key 9db26409a55af74f0b5a957ea9846d1b
I20260809 18:56:34.041781 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.031335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:58741 (local address 127.23.229.62:40923)
0809 18:56:34.031415 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.031417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.031568 (+ 151us) server_negotiation.cc:407] Connection header received
0809 18:56:34.032061 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.032062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.032078 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.032157 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.033024 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.033880 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.035473 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.035790 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.035869 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.038618 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.038619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.038619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.038626 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.040247 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.040760 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.040762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.040763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.040829 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.041102 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.041103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.041104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.041226 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.041302 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.041595 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.041690 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:56:34.041960 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.031255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.23.229.2:58741)
0809 18:56:34.031425 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.031474 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.031962 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.032246 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.032249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.032621 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:34.032913 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.032920 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.033984 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.033985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.035360 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.035364 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.035893 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.035894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.035999 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.036582 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:34.036593 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:34.038513 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:34.040348 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.040355 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.040358 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.040667 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.040900 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.040901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.040902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.041025 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.041292 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:34.041301 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:34.041450 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.041553 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.041719 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260809 18:56:34.042536 26590 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40923
I20260809 18:56:34.042627 26590 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:34.042785 26590 heartbeater.cc:511] Master 127.23.229.62:40923 requested a full tablet report, sending...
I20260809 18:56:34.043119 26050 ts_manager.cc:194] Registered new tserver with Master: e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925)
I20260809 18:56:34.043552 26050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:58741
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
I20260809 18:56:34.050024 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.043663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.23.229.2:59931)
0809 18:56:34.043835 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.043846 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.043911 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.044028 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.044029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.044268 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:34.044338 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.044340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.045075 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.045076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.045621 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.045623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.046185 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.046186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.046253 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.046848 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:34.046853 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:34.047143 (+ 290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:34.048937 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.048938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.048938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.049110 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.049342 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.049343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.049344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.049420 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.049756 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:34.049756 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:34.049796 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.049863 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.049946 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":78,"threads_started":1}
I20260809 18:56:34.050027 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.043723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:59931 (local address 127.23.229.62:40923)
0809 18:56:34.043771 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.043773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.043918 (+ 145us) server_negotiation.cc:407] Connection header received
0809 18:56:34.043952 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.043953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.043965 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.044025 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.044436 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.044967 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.045720 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.046076 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.046164 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.047242 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.047244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.047244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.047252 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.048853 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.049190 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.049192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.049192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.049259 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.049504 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.049505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.049505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.049689 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.049748 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.049889 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.049964 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:34.067726 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40923
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:34.153276 26601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:34.153491 26601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:34.153514 26601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:34.154685 26601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:34.154737 26601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:34.154758 26601 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:34.154805 26601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:34.156340 26601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:40923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:34.156654 26601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:34.156926 26601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:34.162161 26612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:34.162320 26610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:34.162176 26609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:34.162474 26601 server_base.cc:1034] running on GCE node
I20260809 18:56:34.162715 26601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:34.162997 26601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:34.164152 26601 hybrid_clock.cc:648] HybridClock initialized: now 1786301794164130 us; error 40 us; skew 500 ppm
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:34.166904 26601 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:34.167371 26601 webserver.cc:460] Webserver started at http://127.23.229.3:41411/ using document root <none> and password file <none>
I20260809 18:56:34.167578 26601 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:34.167621 26601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:34.167711 26601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:34.168838 26601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "e0d3b5378475473a8dc82f210c3a7223"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-jq4t"
server_key: "81afdcb130c418dc05939e73a2113a1f"
server_key_iv: "68189c97c4aa03a96ff0c107f3645d16"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.169162 26601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "e0d3b5378475473a8dc82f210c3a7223"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-jq4t"
server_key: "81afdcb130c418dc05939e73a2113a1f"
server_key_iv: "68189c97c4aa03a96ff0c107f3645d16"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.170475 26601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:56:34.171277 26622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.171486 26601 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:34.171583 26601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "e0d3b5378475473a8dc82f210c3a7223"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-jq4t"
server_key: "81afdcb130c418dc05939e73a2113a1f"
server_key_iv: "68189c97c4aa03a96ff0c107f3645d16"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.171641 26601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:34.178498 26601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:34.180810 26601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:34.180938 26601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:34.181576 26601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:34.181627 26601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.181649 26601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:34.181663 26601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.188912 26601 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:37459
I20260809 18:56:34.189070 26810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:37459 every 8 connection(s)
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:34.189384 26601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:34.192749 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.182047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:54749 (local address 127.23.229.62:40923)
0809 18:56:34.182125 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.182127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.182299 (+ 172us) server_negotiation.cc:407] Connection header received
0809 18:56:34.182834 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.182836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.182851 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.182909 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.183956 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.184845 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.186440 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.186827 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.186934 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.189870 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.189871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.189872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.189878 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.191394 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.191795 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.191796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.191797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.191851 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.192072 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.192073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.192073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.192205 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.192269 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.192608 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.192682 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:56:34.192976 26637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.182022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.23.229.3:54749)
0809 18:56:34.182173 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.182215 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.182715 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.183033 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.183039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.183477 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:34.183815 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.183823 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.184947 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.184948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.186341 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.186344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.186942 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.186942 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.187049 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.187696 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:34.187708 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:34.189769 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:34.191491 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.191498 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.191500 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.191722 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.191904 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.191905 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.191905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.191994 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.192273 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:34.192278 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:34.192397 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.192564 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.192713 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":85,"threads_started":1}
I20260809 18:56:34.193539 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26601
I20260809 18:56:34.193647 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:34.193840 24468 external_mini_cluster.cc:1428] Setting key ab85f69b1aee32f62fb9b459883b1035
I20260809 18:56:34.194160 26811 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40923
I20260809 18:56:34.194245 26811 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:34.194458 26811 heartbeater.cc:511] Master 127.23.229.62:40923 requested a full tablet report, sending...
I20260809 18:56:34.194854 26050 ts_manager.cc:194] Registered new tserver with Master: e0d3b5378475473a8dc82f210c3a7223 (127.23.229.3:37459)
I20260809 18:56:34.195362 26050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:54749
I20260809 18:56:34.200634 26820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.195257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.23.229.3:59705)
0809 18:56:34.195387 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.195402 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.195473 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.195630 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.195631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.195798 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:34.195848 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.195850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.196556 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.196557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.197069 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.197071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.197450 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.197451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.197533 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.197931 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:34.197936 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:34.198205 (+ 269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:34.199552 (+ 1347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.199553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.199553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.199725 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.199941 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.199941 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.199942 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.200006 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.200263 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:34.200263 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:34.200311 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.200400 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.200532 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":69,"threads_started":1}
I20260809 18:56:34.200634 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.195327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:59705 (local address 127.23.229.62:40923)
0809 18:56:34.195524 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.195525 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.195534 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:34.195555 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.195556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.195566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.195626 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.195950 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.196440 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.197157 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.197368 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.197451 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.198300 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.198301 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.198301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.198309 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.199459 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.199802 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.199803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.199803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.199869 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.200073 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.200074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.200074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.200194 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.200271 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.200428 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.200547 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260809 18:56:34.205996 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:34.231448 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.224281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37796 (local address 127.23.229.62:40923)
0809 18:56:34.224351 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.224352 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.224361 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:34.224390 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.224391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.224401 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.224451 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.225032 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.225569 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.226438 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.226638 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.226694 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.229024 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.229025 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.229025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.229033 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.230479 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.230814 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.230815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.230815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.230869 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.231040 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.231040 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.231041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.231149 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.231225 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.231314 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.231377 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:56:34.233297 26050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:34.234952 26050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:34.241786 26833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.237419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:32925 (local address 127.0.0.1:49198)
0809 18:56:34.237792 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.237838 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.237941 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.238239 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.238240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.238242 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:34.238305 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.238307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.239288 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.239290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.240638 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.240642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.241421 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.241422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.241516 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.241531 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.241635 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.241693 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":70,"threads_started":1}
I20260809 18:56:34.241794 26837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.237548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49198 (local address 127.23.229.2:32925)
0809 18:56:34.237763 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.237769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.237903 (+ 134us) server_negotiation.cc:407] Connection header received
0809 18:56:34.238044 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.238047 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.238070 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.238166 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:34.238369 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.239198 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.240733 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.241327 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.241421 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.241489 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.241656 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.241696 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260809 18:56:34.242012 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.237638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:41045 (local address 127.0.0.1:41248)
0809 18:56:34.238246 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.238256 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.238306 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.238537 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.238538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.238540 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:34.238575 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.238577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.239788 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.239789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.240836 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.240839 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.241760 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.241760 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.241826 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.241831 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.241882 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.241937 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":90,"threads_started":1}
I20260809 18:56:34.242331 26841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.237759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41248 (local address 127.23.229.1:41045)
0809 18:56:34.237951 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.237956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.238376 (+ 420us) server_negotiation.cc:407] Connection header received
0809 18:56:34.238424 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.238426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.238442 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.238520 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:34.238641 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.239692 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.240933 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.241621 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.241679 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.241728 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.242179 (+ 451us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.242222 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":86,"threads_started":1}
I20260809 18:56:34.242369 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.237753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.23.229.3:37459)
0809 18:56:34.237951 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.237956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.238000 (+ 44us) server_negotiation.cc:407] Connection header received
0809 18:56:34.238042 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.238044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.238062 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.238148 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:34.238331 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.239514 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.240807 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.241573 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.241653 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.241714 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.242178 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.242220 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260809 18:56:34.242664 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.237476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:37459 (local address 127.0.0.1:50944)
0809 18:56:34.237809 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.237838 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.237906 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.238156 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.238159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.238161 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:34.238238 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.238240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.239624 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.239625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.240742 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.240745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.241754 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.241755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.241834 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.241839 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.242518 (+ 679us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.242599 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":25,"thread_start_us":85,"threads_started":1}
I20260809 18:56:34.242758 26483 tablet_service.cc:1467] Processing CreateTablet for tablet 3e70b8c3dd4642bda01305ad057bd6a8 (DEFAULT_TABLE table=test-table [id=eb7b0e6d45fa4145978d849b035eec2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:34.243023 26249 tablet_service.cc:1467] Processing CreateTablet for tablet 3e70b8c3dd4642bda01305ad057bd6a8 (DEFAULT_TABLE table=test-table [id=eb7b0e6d45fa4145978d849b035eec2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:34.243135 26483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e70b8c3dd4642bda01305ad057bd6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.243309 26249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e70b8c3dd4642bda01305ad057bd6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.246419 26843 tablet_bootstrap.cc:492] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Bootstrap starting.
I20260809 18:56:34.246610 26842 tablet_bootstrap.cc:492] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Bootstrap starting.
I20260809 18:56:34.246917 26702 tablet_service.cc:1467] Processing CreateTablet for tablet 3e70b8c3dd4642bda01305ad057bd6a8 (DEFAULT_TABLE table=test-table [id=eb7b0e6d45fa4145978d849b035eec2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:34.247115 26843 tablet_bootstrap.cc:654] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.247218 26842 tablet_bootstrap.cc:654] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.247316 26702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e70b8c3dd4642bda01305ad057bd6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.247462 26843 log.cc:824] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:34.247599 26842 log.cc:824] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:34.248222 26843 tablet_bootstrap.cc:492] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: No bootstrap required, opened a new log
I20260809 18:56:34.248310 26843 ts_tablet_manager.cc:1397] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:34.248857 26842 tablet_bootstrap.cc:492] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: No bootstrap required, opened a new log
I20260809 18:56:34.248934 26842 ts_tablet_manager.cc:1397] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 18:56:34.250150 26847 tablet_bootstrap.cc:492] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Bootstrap starting.
I20260809 18:56:34.250411 26843 raft_consensus.cc:348] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.250607 26843 raft_consensus.cc:374] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.250653 26843 raft_consensus.cc:729] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff43129a634ff096728a1c30bc7ee5, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.250779 26843 consensus_queue.cc:260] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.250936 26842 raft_consensus.cc:348] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.251091 26843 ts_tablet_manager.cc:1428] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:34.251108 26842 raft_consensus.cc:374] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.251147 26842 raft_consensus.cc:729] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d7f4ca8ce440c49ab818e512193045, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.251241 26847 tablet_bootstrap.cc:654] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.251241 26378 heartbeater.cc:503] Master 127.23.229.62:40923 was elected leader, sending a full tablet report...
I20260809 18:56:34.251260 26842 consensus_queue.cc:260] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.251518 26842 ts_tablet_manager.cc:1428] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:34.251605 26847 log.cc:824] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:34.251637 26590 heartbeater.cc:503] Master 127.23.229.62:40923 was elected leader, sending a full tablet report...
I20260809 18:56:34.252696 26847 tablet_bootstrap.cc:492] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: No bootstrap required, opened a new log
I20260809 18:56:34.252810 26847 ts_tablet_manager.cc:1397] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:34.254173 26847 raft_consensus.cc:348] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.254298 26847 raft_consensus.cc:374] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.254320 26847 raft_consensus.cc:729] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d3b5378475473a8dc82f210c3a7223, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.254397 26847 consensus_queue.cc:260] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.254602 26847 ts_tablet_manager.cc:1428] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:34.254666 26811 heartbeater.cc:503] Master 127.23.229.62:40923 was elected leader, sending a full tablet report...
W20260809 18:56:34.288743 26592 tablet.cc:2369] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:34.288909 26848 raft_consensus.cc:482] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:34.289041 26848 raft_consensus.cc:504] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.289426 26848 leader_election.cc:288] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925), e0d3b5378475473a8dc82f210c3a7223 (127.23.229.3:37459)
I20260809 18:56:34.293763 26837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.289703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:33957 (local address 127.23.229.2:32925)
0809 18:56:34.289773 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.289776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.289970 (+ 194us) server_negotiation.cc:407] Connection header received
0809 18:56:34.290006 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.290007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.290019 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.290080 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:34.290434 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.291191 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.292742 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.293329 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.293404 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.293414 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.293644 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.293686 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:56:34.293763 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.289714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:47077 (local address 127.23.229.3:37459)
0809 18:56:34.289824 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.289826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.289835 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:34.290507 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.290508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.290526 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.290594 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:34.290734 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.291208 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.292742 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.293316 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.293404 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.293414 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.293643 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.293686 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 18:56:34.293787 26193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.289635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:37459 (local address 127.23.229.1:47077)
0809 18:56:34.289701 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.289716 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.289770 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.290599 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.290600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.290602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:34.290664 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.290665 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.291319 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.291319 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.292637 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.292640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.293436 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.293437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.293553 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.293559 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.293631 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.293688 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":89}
I20260809 18:56:34.293797 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.289644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:32925 (local address 127.23.229.1:33957)
0809 18:56:34.289855 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.289865 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.289933 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.290278 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.290279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.290281 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:34.290350 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.290352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.291309 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.291310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.292637 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.292640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.293436 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.293437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.293553 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.293559 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.293631 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.293686 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":9,"thread_start_us":132,"threads_started":1}
I20260809 18:56:34.294267 26740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e70b8c3dd4642bda01305ad057bd6a8" candidate_uuid: "a1ff43129a634ff096728a1c30bc7ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d3b5378475473a8dc82f210c3a7223" is_pre_election: true
I20260809 18:56:34.294293 26517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e70b8c3dd4642bda01305ad057bd6a8" candidate_uuid: "a1ff43129a634ff096728a1c30bc7ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7f4ca8ce440c49ab818e512193045" is_pre_election: true
I20260809 18:56:34.294452 26517 raft_consensus.cc:2454] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff43129a634ff096728a1c30bc7ee5 in term 0.
I20260809 18:56:34.294452 26740 raft_consensus.cc:2454] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff43129a634ff096728a1c30bc7ee5 in term 0.
I20260809 18:56:34.294721 26185 leader_election.cc:302] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff43129a634ff096728a1c30bc7ee5, e4d7f4ca8ce440c49ab818e512193045; no voters:
I20260809 18:56:34.294972 26848 raft_consensus.cc:2781] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:34.295018 26848 raft_consensus.cc:482] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:34.295107 26848 raft_consensus.cc:3037] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.295866 26848 raft_consensus.cc:504] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.296027 26848 leader_election.cc:288] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [CANDIDATE]: Term 1 election: Requested vote from peers e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925), e0d3b5378475473a8dc82f210c3a7223 (127.23.229.3:37459)
I20260809 18:56:34.296185 26517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e70b8c3dd4642bda01305ad057bd6a8" candidate_uuid: "a1ff43129a634ff096728a1c30bc7ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7f4ca8ce440c49ab818e512193045"
I20260809 18:56:34.296205 26740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e70b8c3dd4642bda01305ad057bd6a8" candidate_uuid: "a1ff43129a634ff096728a1c30bc7ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d3b5378475473a8dc82f210c3a7223"
I20260809 18:56:34.296294 26740 raft_consensus.cc:3037] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.296298 26517 raft_consensus.cc:3037] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.297132 26740 raft_consensus.cc:2454] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff43129a634ff096728a1c30bc7ee5 in term 1.
I20260809 18:56:34.297132 26517 raft_consensus.cc:2454] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff43129a634ff096728a1c30bc7ee5 in term 1.
I20260809 18:56:34.297784 26183 leader_election.cc:302] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff43129a634ff096728a1c30bc7ee5, e0d3b5378475473a8dc82f210c3a7223; no voters:
I20260809 18:56:34.297909 26848 raft_consensus.cc:2781] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:34.298121 26848 raft_consensus.cc:686] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 LEADER]: Becoming Leader. State: Replica: a1ff43129a634ff096728a1c30bc7ee5, State: Running, Role: LEADER
I20260809 18:56:34.298245 26848 consensus_queue.cc:237] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.299197 26051 catalog_manager.cc:5495] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1). New cstate: current_term: 1 leader_uuid: "a1ff43129a634ff096728a1c30bc7ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:34.318732 26841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.316022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41254 (local address 127.23.229.1:41045)
0809 18:56:34.316086 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.316089 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.316100 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:34.316177 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.316178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.316202 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.316282 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:34.316464 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.317008 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.317829 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.318034 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.318110 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.318339 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:34.318454 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:34.318551 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.318608 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.318631 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:56:34.320868 26517 raft_consensus.cc:1261] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Refusing update from remote peer a1ff43129a634ff096728a1c30bc7ee5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:34.320875 26740 raft_consensus.cc:1261] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Refusing update from remote peer a1ff43129a634ff096728a1c30bc7ee5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:34.321262 26848 consensus_queue.cc:1035] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:34.321439 26856 consensus_queue.cc:1035] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:34.324123 26865 mvcc.cc:205] Tried to move back new op lower bound from 7316692149534822400 to 7316692149446209536. Current Snapshot: MvccSnapshot[applied={T|T < 7316692149534822400}]
I20260809 18:56:34.324324 26866 mvcc.cc:205] Tried to move back new op lower bound from 7316692149534822400 to 7316692149446209536. Current Snapshot: MvccSnapshot[applied={T|T < 7316692149534822400}]
I20260809 18:56:34.327674 26050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:34.327796 26050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:34.328656 26050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: Sending DeleteTablet for 3 replicas of tablet 3e70b8c3dd4642bda01305ad057bd6a8
I20260809 18:56:34.329052 26249 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e70b8c3dd4642bda01305ad057bd6a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:41248
I20260809 18:56:34.329062 26483 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e70b8c3dd4642bda01305ad057bd6a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:49198
I20260809 18:56:34.329407 26877 tablet_replica.cc:330] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: stopping tablet replica
I20260809 18:56:34.329384 26702 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e70b8c3dd4642bda01305ad057bd6a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:50944
I20260809 18:56:34.329526 26877 raft_consensus.cc:2229] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:34.329824 26878 tablet_replica.cc:330] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: stopping tablet replica
I20260809 18:56:34.329937 26878 raft_consensus.cc:2229] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:34.329969 26877 raft_consensus.cc:2258] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:34.329913 26050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 18:56:34.330037 26878 raft_consensus.cc:2258] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 18:56:34.330077 26050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:34.330479 26877 ts_tablet_manager.cc:1905] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:34.330482 26878 ts_tablet_manager.cc:1905] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:34.331946 26702 tablet_service.cc:1467] Processing CreateTablet for tablet ab84f013279f493bbee57c9e2cbbec47 (DEFAULT_TABLE table=test-table [id=3ea2a2be0f87431e9d056fcb878e6f58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:34.332073 26702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab84f013279f493bbee57c9e2cbbec47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.332623 26876 tablet_replica.cc:330] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: stopping tablet replica
I20260809 18:56:34.332651 26878 ts_tablet_manager.cc:1918] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:34.332736 26878 log.cc:1196] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/3e70b8c3dd4642bda01305ad057bd6a8
I20260809 18:56:34.332888 26876 raft_consensus.cc:2229] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:34.333015 26878 ts_tablet_manager.cc:1939] T 3e70b8c3dd4642bda01305ad057bd6a8 P e0d3b5378475473a8dc82f210c3a7223: Deleting consensus metadata
I20260809 18:56:34.333348 26847 tablet_bootstrap.cc:492] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Bootstrap starting.
I20260809 18:56:34.333173 26876 raft_consensus.cc:2258] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:34.333498 26033 catalog_manager.cc:4841] TS e0d3b5378475473a8dc82f210c3a7223 (127.23.229.3:37459): tablet 3e70b8c3dd4642bda01305ad057bd6a8 (table test-table [id=eb7b0e6d45fa4145978d849b035eec2f]) successfully deleted
I20260809 18:56:34.333549 26483 tablet_service.cc:1467] Processing CreateTablet for tablet ab84f013279f493bbee57c9e2cbbec47 (DEFAULT_TABLE table=test-table [id=3ea2a2be0f87431e9d056fcb878e6f58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:34.333658 26483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab84f013279f493bbee57c9e2cbbec47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.333820 26847 tablet_bootstrap.cc:654] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.334465 26847 tablet_bootstrap.cc:492] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: No bootstrap required, opened a new log
I20260809 18:56:34.334512 26847 ts_tablet_manager.cc:1397] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:34.334590 26876 ts_tablet_manager.cc:1905] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:34.334661 26847 raft_consensus.cc:348] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.334731 26847 raft_consensus.cc:374] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.334751 26847 raft_consensus.cc:729] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d3b5378475473a8dc82f210c3a7223, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.334798 26847 consensus_queue.cc:260] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.334889 26847 ts_tablet_manager.cc:1428] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.335003 26842 tablet_bootstrap.cc:492] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: Bootstrap starting.
I20260809 18:56:34.335525 26842 tablet_bootstrap.cc:654] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.336086 26249 tablet_service.cc:1467] Processing CreateTablet for tablet ab84f013279f493bbee57c9e2cbbec47 (DEFAULT_TABLE table=test-table [id=3ea2a2be0f87431e9d056fcb878e6f58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:34.336201 26249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab84f013279f493bbee57c9e2cbbec47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.336252 26842 tablet_bootstrap.cc:492] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: No bootstrap required, opened a new log
I20260809 18:56:34.336299 26842 ts_tablet_manager.cc:1397] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:34.336447 26842 raft_consensus.cc:348] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.336571 26842 raft_consensus.cc:374] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.336596 26842 raft_consensus.cc:729] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d7f4ca8ce440c49ab818e512193045, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.336647 26842 consensus_queue.cc:260] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.336737 26842 ts_tablet_manager.cc:1428] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:34.336906 26876 ts_tablet_manager.cc:1918] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:34.336983 26876 log.cc:1196] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/3e70b8c3dd4642bda01305ad057bd6a8
I20260809 18:56:34.337240 26876 ts_tablet_manager.cc:1939] T 3e70b8c3dd4642bda01305ad057bd6a8 P a1ff43129a634ff096728a1c30bc7ee5: Deleting consensus metadata
I20260809 18:56:34.337596 26843 tablet_bootstrap.cc:492] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Bootstrap starting.
I20260809 18:56:34.338058 26843 tablet_bootstrap.cc:654] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.338547 26034 catalog_manager.cc:4841] TS a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1:41045): tablet 3e70b8c3dd4642bda01305ad057bd6a8 (table test-table [id=eb7b0e6d45fa4145978d849b035eec2f]) successfully deleted
I20260809 18:56:34.338762 26843 tablet_bootstrap.cc:492] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: No bootstrap required, opened a new log
I20260809 18:56:34.338806 26843 ts_tablet_manager.cc:1397] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:34.338963 26843 raft_consensus.cc:348] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.339037 26843 raft_consensus.cc:374] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.339057 26843 raft_consensus.cc:729] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff43129a634ff096728a1c30bc7ee5, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.339102 26843 consensus_queue.cc:260] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.339174 26843 ts_tablet_manager.cc:1428] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:34.339323 26877 ts_tablet_manager.cc:1918] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:34.339380 26877 log.cc:1196] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/3e70b8c3dd4642bda01305ad057bd6a8
I20260809 18:56:34.339700 26877 ts_tablet_manager.cc:1939] T 3e70b8c3dd4642bda01305ad057bd6a8 P e4d7f4ca8ce440c49ab818e512193045: Deleting consensus metadata
I20260809 18:56:34.340090 26034 catalog_manager.cc:4841] TS e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925): tablet 3e70b8c3dd4642bda01305ad057bd6a8 (table test-table [id=eb7b0e6d45fa4145978d849b035eec2f]) successfully deleted
W20260809 18:56:34.382210 26379 tablet.cc:2369] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:34.439671 26853 raft_consensus.cc:482] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:34.439810 26853 raft_consensus.cc:504] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
W20260809 18:56:34.440079 26814 tablet.cc:2369] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:34.440234 26853 leader_election.cc:288] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1:41045), e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925)
I20260809 18:56:34.443742 26841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.440556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:35275 (local address 127.23.229.1:41045)
0809 18:56:34.440605 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.440607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.440618 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:34.440654 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.440655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.440666 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.440740 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:34.440993 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.441805 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.442901 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.443379 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.443451 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.443461 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.443626 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.443667 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:56:34.443775 26637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.440433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:41045 (local address 127.23.229.3:35275)
0809 18:56:34.440521 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.440536 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.440589 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.440818 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.440819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.440821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:34.440903 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.440906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.441941 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.441942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.442816 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.442819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.443462 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.443463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.443539 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.443544 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.443606 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.443656 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":36}
I20260809 18:56:34.444234 26294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab84f013279f493bbee57c9e2cbbec47" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff43129a634ff096728a1c30bc7ee5" is_pre_election: true
I20260809 18:56:34.444383 26294 raft_consensus.cc:2454] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 0.
I20260809 18:56:34.444399 26883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.440610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:32925 (local address 127.23.229.3:47647)
0809 18:56:34.440812 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.440822 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.440877 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.441020 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.441020 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.441022 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:34.441086 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.441087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.441974 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.441975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.443311 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.443315 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.444129 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.444130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.444205 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.444209 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.444283 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.444322 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":74,"threads_started":1}
I20260809 18:56:34.444391 26837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.440743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:47647 (local address 127.23.229.2:32925)
0809 18:56:34.440788 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.440790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.440866 (+ 76us) server_negotiation.cc:407] Connection header received
0809 18:56:34.440933 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.440933 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.440943 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.441005 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:34.441159 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.441845 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.443415 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.444006 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.444082 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.444093 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.444290 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.444332 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:56:34.444614 26631 leader_election.cc:302] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff43129a634ff096728a1c30bc7ee5, e0d3b5378475473a8dc82f210c3a7223; no voters:
I20260809 18:56:34.444757 26853 raft_consensus.cc:2781] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:34.444801 26853 raft_consensus.cc:482] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:34.444772 26517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab84f013279f493bbee57c9e2cbbec47" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7f4ca8ce440c49ab818e512193045" is_pre_election: true
I20260809 18:56:34.444834 26853 raft_consensus.cc:3037] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.444872 26517 raft_consensus.cc:2454] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 0.
I20260809 18:56:34.445633 26853 raft_consensus.cc:504] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.445788 26853 leader_election.cc:288] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 election: Requested vote from peers a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1:41045), e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925)
I20260809 18:56:34.445984 26517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab84f013279f493bbee57c9e2cbbec47" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7f4ca8ce440c49ab818e512193045"
I20260809 18:56:34.445990 26294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab84f013279f493bbee57c9e2cbbec47" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff43129a634ff096728a1c30bc7ee5"
I20260809 18:56:34.446051 26517 raft_consensus.cc:3037] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.446065 26294 raft_consensus.cc:3037] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.446615 26517 raft_consensus.cc:2454] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 1.
I20260809 18:56:34.446874 26294 raft_consensus.cc:2454] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 1.
I20260809 18:56:34.447062 26631 leader_election.cc:302] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d3b5378475473a8dc82f210c3a7223, e4d7f4ca8ce440c49ab818e512193045; no voters:
I20260809 18:56:34.447153 26853 raft_consensus.cc:2781] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:34.447324 26853 raft_consensus.cc:686] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 1 LEADER]: Becoming Leader. State: Replica: e0d3b5378475473a8dc82f210c3a7223, State: Running, Role: LEADER
I20260809 18:56:34.447392 26853 consensus_queue.cc:237] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.448176 26050 catalog_manager.cc:5495] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d3b5378475473a8dc82f210c3a7223 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } health_report { overall_health: HEALTHY } } }
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301793, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:34.504858 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.493372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.0.0.1:37806)
0809 18:56:34.493636 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.493648 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.493722 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.493885 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.493886 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.494252 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:34.494308 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.494311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.495092 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.495093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.495655 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.495657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.496031 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.496032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.496082 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.500331 (+ 4249us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:34.500336 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:34.501982 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:34.503673 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.503683 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.503686 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.503928 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.504158 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:34.504159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:34.504159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:34.504230 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:34.504526 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:34.504537 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:34.504598 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.504657 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.504774 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":176,"threads_started":1}
I20260809 18:56:34.504928 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.493470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37806 (local address 127.23.229.62:40923)
0809 18:56:34.493587 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.493590 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.493725 (+ 135us) server_negotiation.cc:407] Connection header received
0809 18:56:34.493768 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.493769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.493780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.493839 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.494409 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.494990 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.495744 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.495952 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.496010 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.502082 (+ 6072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.502084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.502084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.502092 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.503577 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.504006 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.504008 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.504008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.504069 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.504296 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.504297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.504297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.504417 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.504469 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.504695 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.504840 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":74}
I20260809 18:56:34.507135 26050 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:37806:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:56:34.507332 26050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:34.509756 26483 tablet_service.cc:1467] Processing CreateTablet for tablet 6ebc55acb0e648c8917a6b62023794d0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f134bd0272e646959716f355d5a52ffb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:34.509747 26702 tablet_service.cc:1467] Processing CreateTablet for tablet 6ebc55acb0e648c8917a6b62023794d0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f134bd0272e646959716f355d5a52ffb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:34.509786 26249 tablet_service.cc:1467] Processing CreateTablet for tablet 6ebc55acb0e648c8917a6b62023794d0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f134bd0272e646959716f355d5a52ffb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:34.509958 26702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ebc55acb0e648c8917a6b62023794d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.509961 26249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ebc55acb0e648c8917a6b62023794d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.509956 26483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ebc55acb0e648c8917a6b62023794d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.511435 26842 tablet_bootstrap.cc:492] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: Bootstrap starting.
I20260809 18:56:34.511582 26843 tablet_bootstrap.cc:492] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: Bootstrap starting.
I20260809 18:56:34.511937 26842 tablet_bootstrap.cc:654] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.512015 26843 tablet_bootstrap.cc:654] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.512297 26847 tablet_bootstrap.cc:492] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: Bootstrap starting.
I20260809 18:56:34.512670 26843 tablet_bootstrap.cc:492] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: No bootstrap required, opened a new log
I20260809 18:56:34.512728 26843 ts_tablet_manager.cc:1397] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:34.512856 26842 tablet_bootstrap.cc:492] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: No bootstrap required, opened a new log
I20260809 18:56:34.512895 26842 ts_tablet_manager.cc:1397] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:34.512940 26847 tablet_bootstrap.cc:654] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.512871 26843 raft_consensus.cc:348] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.512979 26843 raft_consensus.cc:374] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.513005 26843 raft_consensus.cc:729] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff43129a634ff096728a1c30bc7ee5, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.513057 26843 consensus_queue.cc:260] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.513063 26842 raft_consensus.cc:348] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.513131 26842 raft_consensus.cc:374] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.513151 26842 raft_consensus.cc:729] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d7f4ca8ce440c49ab818e512193045, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.513163 26843 ts_tablet_manager.cc:1428] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.513196 26842 consensus_queue.cc:260] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.513198 26856 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.513303 26856 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:34.513371 26849 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.513461 26849 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:34.513623 26842 ts_tablet_manager.cc:1428] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:34.513921 26847 tablet_bootstrap.cc:492] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: No bootstrap required, opened a new log
I20260809 18:56:34.513995 26847 ts_tablet_manager.cc:1397] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:56:34.514322 26847 raft_consensus.cc:348] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.514415 26847 raft_consensus.cc:374] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.514438 26847 raft_consensus.cc:729] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d3b5378475473a8dc82f210c3a7223, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.514492 26847 consensus_queue.cc:260] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.514595 26847 ts_tablet_manager.cc:1428] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:34.514716 26853 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.514781 26853 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:34.725198 26853 raft_consensus.cc:482] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:34.725329 26853 raft_consensus.cc:504] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.725495 26853 leader_election.cc:288] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1:41045), e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925)
I20260809 18:56:34.725828 26294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ebc55acb0e648c8917a6b62023794d0" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff43129a634ff096728a1c30bc7ee5" is_pre_election: true
I20260809 18:56:34.725951 26294 raft_consensus.cc:2454] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 0.
I20260809 18:56:34.725867 26517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ebc55acb0e648c8917a6b62023794d0" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7f4ca8ce440c49ab818e512193045" is_pre_election: true
I20260809 18:56:34.726004 26517 raft_consensus.cc:2454] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 0.
I20260809 18:56:34.726161 26631 leader_election.cc:302] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff43129a634ff096728a1c30bc7ee5, e0d3b5378475473a8dc82f210c3a7223; no voters:
I20260809 18:56:34.726259 26853 raft_consensus.cc:2781] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:34.726331 26853 raft_consensus.cc:482] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:34.726364 26853 raft_consensus.cc:3037] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.727087 26853 raft_consensus.cc:504] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.727233 26853 leader_election.cc:288] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 election: Requested vote from peers a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1:41045), e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925)
I20260809 18:56:34.727406 26294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ebc55acb0e648c8917a6b62023794d0" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff43129a634ff096728a1c30bc7ee5"
I20260809 18:56:34.727425 26517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ebc55acb0e648c8917a6b62023794d0" candidate_uuid: "e0d3b5378475473a8dc82f210c3a7223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7f4ca8ce440c49ab818e512193045"
I20260809 18:56:34.727494 26294 raft_consensus.cc:3037] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.727516 26517 raft_consensus.cc:3037] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.728133 26517 raft_consensus.cc:2454] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 1.
I20260809 18:56:34.728179 26294 raft_consensus.cc:2454] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d3b5378475473a8dc82f210c3a7223 in term 1.
I20260809 18:56:34.728338 26631 leader_election.cc:302] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0d3b5378475473a8dc82f210c3a7223, e4d7f4ca8ce440c49ab818e512193045; no voters:
I20260809 18:56:34.728446 26853 raft_consensus.cc:2781] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:34.728541 26853 raft_consensus.cc:686] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [term 1 LEADER]: Becoming Leader. State: Replica: e0d3b5378475473a8dc82f210c3a7223, State: Running, Role: LEADER
I20260809 18:56:34.728609 26853 consensus_queue.cc:237] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } }
I20260809 18:56:34.728965 26884 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: TxnStatusTablet state changed. Reason: New leader e0d3b5378475473a8dc82f210c3a7223. Latest consensus state: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.729233 26884 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:34.729434 26050 catalog_manager.cc:5495] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d3b5378475473a8dc82f210c3a7223 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:34.729748 26904 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:56:34.729902 26904 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:56:34.744189 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.741382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:37459 (local address 127.0.0.1:50958)
0809 18:56:34.741459 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.741471 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.741532 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.741727 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.741728 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.741729 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:34.741790 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.741794 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.742505 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.742507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.743210 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.743212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.743590 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.743591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.743661 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.743687 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:34.744003 (+ 316us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:34.744016 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.744063 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.744118 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:56:34.744171 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.741450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50958 (local address 127.23.229.3:37459)
0809 18:56:34.741507 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.741510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.741519 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:34.741613 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.741614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.741634 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.741720 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:34.741859 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.742408 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.743309 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.743515 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.743591 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.743802 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:34.743926 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:34.744009 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.744066 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.744089 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 18:56:34.745445 26517 raft_consensus.cc:1261] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Refusing update from remote peer e0d3b5378475473a8dc82f210c3a7223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:34.745630 26294 raft_consensus.cc:1261] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Refusing update from remote peer e0d3b5378475473a8dc82f210c3a7223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:34.745718 26884 consensus_queue.cc:1035] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:34.745992 26884 consensus_queue.cc:1035] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:34.746309 26849 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: TxnStatusTablet state changed. Reason: New leader e0d3b5378475473a8dc82f210c3a7223. Latest consensus state: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.746416 26849 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:34.746999 26856 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: TxnStatusTablet state changed. Reason: New leader e0d3b5378475473a8dc82f210c3a7223. Latest consensus state: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.747089 26856 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:34.747632 26853 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.747711 26853 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:34.747766 26884 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.747853 26884 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P e0d3b5378475473a8dc82f210c3a7223: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:34.748116 26849 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.748199 26849 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P e4d7f4ca8ce440c49ab818e512193045: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:34.749436 26856 tablet_replica.cc:439] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e0d3b5378475473a8dc82f210c3a7223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 } } peers { permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 } } peers { permanent_uuid: "e0d3b5378475473a8dc82f210c3a7223" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37459 } } }
I20260809 18:56:34.749531 26856 tablet_replica.cc:442] T 6ebc55acb0e648c8917a6b62023794d0 P a1ff43129a634ff096728a1c30bc7ee5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:34.752298 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.749896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.23.229.3:37459)
0809 18:56:34.749934 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.749936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.750016 (+ 80us) server_negotiation.cc:407] Connection header received
0809 18:56:34.750053 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.750053 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.750064 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.750108 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:34.750273 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.750865 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.751609 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.751823 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.751903 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.752052 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:34.752088 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:34.752136 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.752194 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.752214 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:56:34.758291 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.755235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:32851 (local address 127.23.229.3:37459)
0809 18:56:34.755304 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.755306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.755499 (+ 193us) server_negotiation.cc:407] Connection header received
0809 18:56:34.755526 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.755527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.755538 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.755595 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:34.755782 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.756263 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.757521 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.757706 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.757769 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.758014 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:34.758048 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:34.758105 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.758183 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.758203 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:56:34.758432 26913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.755183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:37459 (local address 127.23.229.3:32851)
0809 18:56:34.755390 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:34.755401 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:34.755472 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:34.755618 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:34.755619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:34.755620 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:34.755687 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.755689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.756348 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.756349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.757421 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:34.757424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.757788 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.757789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:34.757872 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.757895 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:34.758125 (+ 230us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:34.758127 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:56:34.758181 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:56:34.758230 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":78,"threads_started":1}
I20260809 18:56:34.761276 26517 raft_consensus.cc:1261] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Refusing update from remote peer e0d3b5378475473a8dc82f210c3a7223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:34.761444 26294 raft_consensus.cc:1261] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Refusing update from remote peer e0d3b5378475473a8dc82f210c3a7223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:34.761534 26909 consensus_queue.cc:1035] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d7f4ca8ce440c49ab818e512193045" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:34.761636 26884 consensus_queue.cc:1035] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff43129a634ff096728a1c30bc7ee5" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:34.763099 26867 mvcc.cc:205] Tried to move back new op lower bound from 7316692151340695552 to 7316692150057041920. Current Snapshot: MvccSnapshot[applied={T|T < 7316692151340695552}]
I20260809 18:56:34.773726 26050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:34.773859 26050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:34.774588 26050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6f2989d3d0a4901b96271b5d3e62d60: Sending DeleteTablet for 3 replicas of tablet ab84f013279f493bbee57c9e2cbbec47
I20260809 18:56:34.774892 26702 tablet_service.cc:1514] Processing DeleteTablet for tablet ab84f013279f493bbee57c9e2cbbec47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:50944
I20260809 18:56:34.774878 26249 tablet_service.cc:1514] Processing DeleteTablet for tablet ab84f013279f493bbee57c9e2cbbec47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:41248
I20260809 18:56:34.774920 26483 tablet_service.cc:1514] Processing DeleteTablet for tablet ab84f013279f493bbee57c9e2cbbec47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:49198
I20260809 18:56:34.774981 26878 tablet_replica.cc:330] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: stopping tablet replica
I20260809 18:56:34.775027 26878 raft_consensus.cc:2229] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:34.775036 26877 tablet_replica.cc:330] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: stopping tablet replica
I20260809 18:56:34.775038 26876 tablet_replica.cc:330] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: stopping tablet replica
I20260809 18:56:34.775089 26877 raft_consensus.cc:2229] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:34.775101 26876 raft_consensus.cc:2229] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:34.775123 26877 raft_consensus.cc:2258] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:34.775138 26876 raft_consensus.cc:2258] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:34.775143 26878 raft_consensus.cc:2258] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:34.775576 26876 ts_tablet_manager.cc:1905] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:34.775611 26877 ts_tablet_manager.cc:1905] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:34.776674 26878 ts_tablet_manager.cc:1905] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:34.777205 26877 ts_tablet_manager.cc:1918] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:34.777266 26877 log.cc:1196] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/ab84f013279f493bbee57c9e2cbbec47
I20260809 18:56:34.777505 26877 ts_tablet_manager.cc:1939] T ab84f013279f493bbee57c9e2cbbec47 P e4d7f4ca8ce440c49ab818e512193045: Deleting consensus metadata
I20260809 18:56:34.778240 26878 ts_tablet_manager.cc:1918] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:34.778308 26878 log.cc:1196] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/ab84f013279f493bbee57c9e2cbbec47
I20260809 18:56:34.778522 26878 ts_tablet_manager.cc:1939] T ab84f013279f493bbee57c9e2cbbec47 P e0d3b5378475473a8dc82f210c3a7223: Deleting consensus metadata
I20260809 18:56:34.778851 26034 catalog_manager.cc:4841] TS e4d7f4ca8ce440c49ab818e512193045 (127.23.229.2:32925): tablet ab84f013279f493bbee57c9e2cbbec47 (table test-table [id=3ea2a2be0f87431e9d056fcb878e6f58]) successfully deleted
I20260809 18:56:34.778911 26033 catalog_manager.cc:4841] TS e0d3b5378475473a8dc82f210c3a7223 (127.23.229.3:37459): tablet ab84f013279f493bbee57c9e2cbbec47 (table test-table [id=3ea2a2be0f87431e9d056fcb878e6f58]) successfully deleted
I20260809 18:56:34.779846 26876 ts_tablet_manager.cc:1918] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:34.779917 26876 log.cc:1196] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/ab84f013279f493bbee57c9e2cbbec47
I20260809 18:56:34.780161 26876 ts_tablet_manager.cc:1939] T ab84f013279f493bbee57c9e2cbbec47 P a1ff43129a634ff096728a1c30bc7ee5: Deleting consensus metadata
I20260809 18:56:34.780509 26034 catalog_manager.cc:4841] TS a1ff43129a634ff096728a1c30bc7ee5 (127.23.229.1:41045): tablet ab84f013279f493bbee57c9e2cbbec47 (table test-table [id=3ea2a2be0f87431e9d056fcb878e6f58]) successfully deleted
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[25996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:34.789827 26841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.778750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41264 (local address 127.23.229.1:41045)
0809 18:56:34.778795 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.778798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.780690 (+ 1892us) server_negotiation.cc:407] Connection header received
0809 18:56:34.780761 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.780763 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.780775 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.780840 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.781515 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.782298 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.783037 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.783348 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.783423 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.786746 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.786759 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.786760 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.786767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.788569 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.788976 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.788980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.788980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.789041 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.789247 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.789247 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.789248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.789434 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.789615 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.789686 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.789757 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 18:56:34.790211 26359 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41264
I20260809 18:56:34.798262 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.791340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37816 (local address 127.23.229.62:40923)
0809 18:56:34.791394 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.791396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.791405 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:34.791437 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.791438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.791451 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.791519 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.791972 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.792788 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.793458 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.793819 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.793887 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.795457 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.795459 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.795459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.795467 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.797086 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.797497 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.797498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.797498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.797565 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.797753 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.797754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.797754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.797892 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.798000 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.798078 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.798159 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260809 18:56:34.798488 26050 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37816
I20260809 18:56:34.799182 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26156
I20260809 18:56:34.813695 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26388
I20260809 18:56:34.831501 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26601
I20260809 18:56:34.843945 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26011
2026-08-09T18:56:34Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2651 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[26929](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[26929](info): set up 2 sockets
Aug 09 18:56:34 dist-test-slave-jq4t krb5kdc[26929](info): commencing operation
krb5kdc: starting...
W20260809 18:56:36.108553 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:36.237389 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:44525
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:44525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:36.325872 26950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:36.326145 26950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:36.326184 26950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:36.327394 26950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:36.327474 26950 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:56:36.327497 26950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:36.327520 26950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:36.327560 26950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:36.327584 26950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:36.329299 26950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:44525
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:44525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:36.329627 26950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:36.329890 26950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:36.335587 26961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.335575 26965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:36.335605 26950 server_base.cc:1034] running on GCE node
W20260809 18:56:36.335575 26960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:36.336033 26950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:36.336380 26950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:36.337589 26950 hybrid_clock.cc:648] HybridClock initialized: now 1786301796337579 us; error 68 us; skew 500 ppm
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:36.340379 26950 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:36.340891 26950 webserver.cc:460] Webserver started at http://127.23.229.62:43469/ using document root <none> and password file <none>
I20260809 18:56:36.341135 26950 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:36.341203 26950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:36.341362 26950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:36.342581 26950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "709d5b3519734a7a9fd91919977fd7f8"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "d1afcf5c50d6a471751b224e86a88ddc"
server_key_iv: "04b6102f52dd19dde9aaed7678c1ada3"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.342998 26950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "709d5b3519734a7a9fd91919977fd7f8"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "d1afcf5c50d6a471751b224e86a88ddc"
server_key_iv: "04b6102f52dd19dde9aaed7678c1ada3"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.344529 26950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:36.345371 26972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.345557 26950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:36.345665 26950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "709d5b3519734a7a9fd91919977fd7f8"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "d1afcf5c50d6a471751b224e86a88ddc"
server_key_iv: "04b6102f52dd19dde9aaed7678c1ada3"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.345753 26950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:36.355628 26950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:36.358187 26950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:36.358355 26950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:36.363610 26950 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:44525
I20260809 18:56:36.363675 27064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:44525 every 8 connection(s)
I20260809 18:56:36.364023 26950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:36.364779 27065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:36.367228 27065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Bootstrap starting.
I20260809 18:56:36.367892 27065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:36.368206 27065 log.cc:824] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:36.369026 27065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: No bootstrap required, opened a new log
I20260809 18:56:36.371284 27065 raft_consensus.cc:348] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "709d5b3519734a7a9fd91919977fd7f8" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44525 } }
I20260809 18:56:36.371464 27065 raft_consensus.cc:374] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:36.371568 27065 raft_consensus.cc:729] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 709d5b3519734a7a9fd91919977fd7f8, State: Initialized, Role: FOLLOWER
I20260809 18:56:36.371747 27065 consensus_queue.cc:260] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "709d5b3519734a7a9fd91919977fd7f8" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44525 } }
I20260809 18:56:36.371835 27065 raft_consensus.cc:388] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:36.371881 27065 raft_consensus.cc:482] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:36.371932 27065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:36.372594 27065 raft_consensus.cc:504] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "709d5b3519734a7a9fd91919977fd7f8" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44525 } }
I20260809 18:56:36.372726 27065 leader_election.cc:302] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 709d5b3519734a7a9fd91919977fd7f8; no voters:
I20260809 18:56:36.372917 27065 leader_election.cc:288] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:36.373014 27069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:36.373188 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26950
I20260809 18:56:36.373224 27065 sys_catalog.cc:564] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:36.373225 27069 raft_consensus.cc:686] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [term 1 LEADER]: Becoming Leader. State: Replica: 709d5b3519734a7a9fd91919977fd7f8, State: Running, Role: LEADER
I20260809 18:56:36.373291 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:36.373479 24468 external_mini_cluster.cc:1428] Setting key fb85e5767afc8e5b5f310864ac82a7f6
I20260809 18:56:36.373376 27069 consensus_queue.cc:237] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "709d5b3519734a7a9fd91919977fd7f8" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44525 } }
I20260809 18:56:36.373932 27071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 709d5b3519734a7a9fd91919977fd7f8. Latest consensus state: current_term: 1 leader_uuid: "709d5b3519734a7a9fd91919977fd7f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "709d5b3519734a7a9fd91919977fd7f8" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44525 } } }
I20260809 18:56:36.374536 27071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:36.374441 27070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "709d5b3519734a7a9fd91919977fd7f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "709d5b3519734a7a9fd91919977fd7f8" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44525 } } }
I20260809 18:56:36.374831 27070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:36.374859 27081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:36.375504 27081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:36.377650 27081 catalog_manager.cc:1347] Generated new cluster ID: 32c9d58b104845b18cd6e470bd0bb6b4
I20260809 18:56:36.377714 27081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:36.386719 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.374216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39824 (local address 127.23.229.62:44525)
0809 18:56:36.374746 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.374757 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.374799 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:56:36.374935 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.374943 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.375006 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.375158 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.376064 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.377493 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.378644 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.379291 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.379388 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.382471 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.382478 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.382479 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.382496 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.384802 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.385226 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.385232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.385232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.385394 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.385610 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.385611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.385611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.386002 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.386194 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.386277 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.386453 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":100,"threads_started":1}
I20260809 18:56:36.412914 27081 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:36.413725 27081 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:36.421991 27081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Generated new TSK 0
I20260809 18:56:36.422257 27081 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:36.455793 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:44525
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:36.543051 27100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:36.543306 27100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:36.543350 27100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:36.544617 27100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:36.544679 27100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:36.544713 27100 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:56:36.544745 27100 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:36.544785 27100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:36.546339 27100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:44525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:36.546658 27100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:36.546911 27100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:36.552222 27113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.552234 27108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.552263 27110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:36.552462 27100 server_base.cc:1034] running on GCE node
I20260809 18:56:36.552719 27100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:36.553025 27100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:36.554183 27100 hybrid_clock.cc:648] HybridClock initialized: now 1786301796554159 us; error 42 us; skew 500 ppm
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:36.557178 27100 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:36.557626 27100 webserver.cc:460] Webserver started at http://127.23.229.1:34015/ using document root <none> and password file <none>
I20260809 18:56:36.557886 27100 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:36.557956 27100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:36.558121 27100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:36.559199 27100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "eef4362bd41c472f85fabcd4f25dceb7"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "4f334a3872c235565ec8ce0ef0e9ef74"
server_key_iv: "a27a3f698727c4e65b5da469dd8d8df1"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.559574 27100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "eef4362bd41c472f85fabcd4f25dceb7"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "4f334a3872c235565ec8ce0ef0e9ef74"
server_key_iv: "a27a3f698727c4e65b5da469dd8d8df1"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.561045 27100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:36.561790 27122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.561942 27100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:36.562064 27100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "eef4362bd41c472f85fabcd4f25dceb7"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "4f334a3872c235565ec8ce0ef0e9ef74"
server_key_iv: "a27a3f698727c4e65b5da469dd8d8df1"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.562143 27100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:36.578158 27100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:36.580266 27100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:36.580452 27100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:36.581075 27100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:36.581140 27100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.581193 27100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:36.581221 27100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:36.589030 27100 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:38853
I20260809 18:56:36.589399 27100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:36.589438 27301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:38853 every 8 connection(s)
I20260809 18:56:36.592022 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.581686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:51177 (local address 127.23.229.62:44525)
0809 18:56:36.581741 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.581743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.581992 (+ 249us) server_negotiation.cc:407] Connection header received
0809 18:56:36.582591 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.582592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.582612 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.582663 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.583612 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.584506 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.585716 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.585945 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.586030 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.588777 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.588779 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.588779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.588787 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.590514 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.590961 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.590962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.590963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.591030 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.591317 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.591318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.591318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.591454 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.591530 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.591832 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.591932 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:56:36.592233 27141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.581690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:44525 (local address 127.23.229.1:51177)
0809 18:56:36.581863 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.581901 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.582454 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.582743 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.582747 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.583170 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:36.583484 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.583492 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.584632 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.584633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.585619 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.585623 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.586053 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.586054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.586220 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.586835 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:36.586844 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:36.588665 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:36.590620 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.590628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.590630 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.590877 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.591119 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.591120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.591120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.591246 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.591533 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:36.591549 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:36.591696 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.591808 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.591976 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
I20260809 18:56:36.592339 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 27100
I20260809 18:56:36.592447 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:36.592657 24468 external_mini_cluster.cc:1428] Setting key 6519601258e81f7c74e2e424dac3c55e
I20260809 18:56:36.592865 27302 heartbeater.cc:347] Connected to a master server at 127.23.229.62:44525
I20260809 18:56:36.592952 27302 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:36.593137 27302 heartbeater.cc:511] Master 127.23.229.62:44525 requested a full tablet report, sending...
I20260809 18:56:36.593834 27000 ts_manager.cc:194] Registered new tserver with Master: eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853)
I20260809 18:56:36.594755 27000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:51177
I20260809 18:56:36.601112 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.595113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:44525 (local address 127.23.229.1:55445)
0809 18:56:36.595238 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.595248 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.595326 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.595454 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.595454 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.595650 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:36.595707 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.595708 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.596371 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.596372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.596954 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.596956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.597334 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.597335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.597416 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.597883 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:36.597888 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:36.598259 (+ 371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:36.599986 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.599987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.599987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.600174 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.600394 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.600395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.600396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.600459 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.600754 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:36.600755 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:36.600805 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.600895 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.601011 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260809 18:56:36.601106 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.595151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:55445 (local address 127.23.229.62:44525)
0809 18:56:36.595191 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.595193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.595311 (+ 118us) server_negotiation.cc:407] Connection header received
0809 18:56:36.595385 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.595386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.595396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.595440 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.595782 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.596270 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.597038 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.597250 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.597323 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.598344 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.598345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.598346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.598353 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.599867 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.600253 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.600255 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.600255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.600315 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.600558 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.600559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.600559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.600682 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.600761 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.600924 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.601011 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:36.621899 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:44525
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:36.709286 27316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:36.709506 27316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:36.709530 27316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:36.710611 27316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:36.710647 27316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:36.710668 27316 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:56:36.710680 27316 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:36.710697 27316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:36.712107 27316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:44525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:36.712296 27316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:36.712534 27316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:36.717665 27330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.717649 27326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.717649 27324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:36.717916 27316 server_base.cc:1034] running on GCE node
I20260809 18:56:36.718117 27316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:36.718326 27316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:36.719476 27316 hybrid_clock.cc:648] HybridClock initialized: now 1786301796719467 us; error 29 us; skew 500 ppm
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:36.722142 27316 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:36.722620 27316 webserver.cc:460] Webserver started at http://127.23.229.2:45761/ using document root <none> and password file <none>
I20260809 18:56:36.722848 27316 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:36.722894 27316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:36.723073 27316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:36.724131 27316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "32781598729e42c4a7229fc45fa0e1a5"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "d87be17a1dec7b3e5ebc08f244285516"
server_key_iv: "f744914107dff68dc9ae16726bd85783"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.724553 27316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "32781598729e42c4a7229fc45fa0e1a5"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "d87be17a1dec7b3e5ebc08f244285516"
server_key_iv: "f744914107dff68dc9ae16726bd85783"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.725881 27316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:36.726581 27343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.726776 27316 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:36.726872 27316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "32781598729e42c4a7229fc45fa0e1a5"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "d87be17a1dec7b3e5ebc08f244285516"
server_key_iv: "f744914107dff68dc9ae16726bd85783"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.726943 27316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:36.756209 27316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:36.758944 27316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:36.759125 27316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:36.759842 27316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:36.759898 27316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.759933 27316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:36.759953 27316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:36.767545 27316 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:44789
I20260809 18:56:36.767669 27533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:44789 every 8 connection(s)
I20260809 18:56:36.768007 27316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:36.768656 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 27316
I20260809 18:56:36.768770 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:36.768975 24468 external_mini_cluster.cc:1428] Setting key f251cb5037c65114749622d86e027f3c
I20260809 18:56:36.770370 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.760364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:34119 (local address 127.23.229.62:44525)
0809 18:56:36.760442 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.760445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.760684 (+ 239us) server_negotiation.cc:407] Connection header received
0809 18:56:36.761205 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.761206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.761224 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.761312 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.762053 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.762596 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.763632 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.763846 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.763936 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.767047 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.767048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.767048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.767058 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.768909 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.769378 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.769379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.769380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.769447 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.769669 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.769671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.769671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.769809 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.769888 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.770189 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.770281 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:56:36.770548 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.760338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:44525 (local address 127.23.229.2:34119)
0809 18:56:36.760537 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.760583 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.761100 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.761424 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.761427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.761733 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:36.761949 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.761954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.762697 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.762699 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.763534 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.763535 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.763948 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.763949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.764137 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.764749 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:36.764758 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:36.766937 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:36.768995 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.769003 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.769005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.769306 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.769502 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.769503 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.769503 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.769594 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.769890 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:36.769898 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:36.770046 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.770153 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.770318 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
I20260809 18:56:36.771876 27536 heartbeater.cc:347] Connected to a master server at 127.23.229.62:44525
I20260809 18:56:36.771970 27536 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:36.772177 27536 heartbeater.cc:511] Master 127.23.229.62:44525 requested a full tablet report, sending...
I20260809 18:56:36.772600 27000 ts_manager.cc:194] Registered new tserver with Master: 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789)
I20260809 18:56:36.773139 27000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:34119
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
I20260809 18:56:36.780087 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.773092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:34043 (local address 127.23.229.62:44525)
0809 18:56:36.773153 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.773155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.773283 (+ 128us) server_negotiation.cc:407] Connection header received
0809 18:56:36.773395 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.773397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.773409 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.773474 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.773877 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.774700 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.775472 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.775808 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.775893 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.777046 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.777048 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.777048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.777056 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.778786 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.779148 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.779149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.779150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.779214 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.779411 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.779412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.779412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.779637 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.779722 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.779935 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.780008 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:56:36.780109 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.773043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:44525 (local address 127.23.229.2:34043)
0809 18:56:36.773222 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.773233 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.773309 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.773492 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.773493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.773724 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:36.773789 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.773791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.774801 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.774802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.775379 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.775381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.775889 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.775889 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.775949 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.776524 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:36.776529 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:36.776849 (+ 320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:36.778890 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.778891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.778891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.779067 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.779289 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.779289 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.779290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.779342 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.779757 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:36.779758 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:36.779813 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.779899 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.780023 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":74,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:36.798990 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:44525
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:36.883909 27553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:36.884133 27553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:36.884158 27553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:36.885339 27553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:36.885383 27553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:36.885404 27553 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:56:36.885458 27553 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:36.885494 27553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:36.887036 27553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:44525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:36.887295 27553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:36.887547 27553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:36.895789 27564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:36.895874 27553 server_base.cc:1034] running on GCE node
W20260809 18:56:36.895789 27567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.896116 27562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:36.896396 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:36.899178 27553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:36.900359 27553 hybrid_clock.cc:648] HybridClock initialized: now 1786301796900342 us; error 35 us; skew 500 ppm
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:36.903250 27553 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:36.903738 27553 webserver.cc:460] Webserver started at http://127.23.229.3:39451/ using document root <none> and password file <none>
I20260809 18:56:36.904013 27553 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:36.904095 27553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:36.904260 27553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:36.905457 27553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "0394fee9cad54c0a925eacdc3f52f6ba"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "613e4c939f6c636c34783cc5f7ee11d0"
server_key_iv: "dee72879634ea45acb268d17396b56dc"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.905841 27553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "0394fee9cad54c0a925eacdc3f52f6ba"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "613e4c939f6c636c34783cc5f7ee11d0"
server_key_iv: "dee72879634ea45acb268d17396b56dc"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.907277 27553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:56:36.908007 27581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.908179 27553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:36.908284 27553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "0394fee9cad54c0a925eacdc3f52f6ba"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-jq4t"
server_key: "613e4c939f6c636c34783cc5f7ee11d0"
server_key_iv: "dee72879634ea45acb268d17396b56dc"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.908370 27553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:36.925231 27553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:36.927273 27553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:36.927443 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:36.927995 27553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:36.928076 27553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.928146 27553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:36.928177 27553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:36.935451 27553 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:33337
I20260809 18:56:36.935542 27781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:33337 every 8 connection(s)
I20260809 18:56:36.935906 27553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:36.938679 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.928621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:55175 (local address 127.23.229.62:44525)
0809 18:56:36.928666 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.928668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.928895 (+ 227us) server_negotiation.cc:407] Connection header received
0809 18:56:36.929445 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.929446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.929469 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.929536 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.930260 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.931079 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.932729 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.932944 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.933033 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.935529 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.935531 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.935531 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.935548 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.937316 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.937766 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.937767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.937768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.937832 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.938073 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.938074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.938074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.938200 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.938257 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.938515 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.938602 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:56:36.938768 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.928616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:44525 (local address 127.23.229.3:55175)
0809 18:56:36.928772 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.928808 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.929333 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.929614 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.929617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.929964 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:36.930158 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.930163 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.931180 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.931181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.932622 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.932625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.933057 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.933059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.933205 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.933720 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:36.933728 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:36.935405 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:36.937401 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.937407 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.937409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.937667 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.937906 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.937907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.937907 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.938011 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.938244 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:36.938247 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:36.938365 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.938448 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.938595 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":94,"threads_started":1}
I20260809 18:56:36.939385 27783 heartbeater.cc:347] Connected to a master server at 127.23.229.62:44525
I20260809 18:56:36.939481 27783 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:36.939683 27783 heartbeater.cc:511] Master 127.23.229.62:44525 requested a full tablet report, sending...
I20260809 18:56:36.940124 27000 ts_manager.cc:194] Registered new tserver with Master: 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3:33337)
I20260809 18:56:36.940660 27000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:55175
I20260809 18:56:36.945210 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 27553
I20260809 18:56:36.945322 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:36.945582 24468 external_mini_cluster.cc:1428] Setting key 4b1466b9b54649461e5216efddc43bfa
I20260809 18:56:36.946229 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.940751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:58587 (local address 127.23.229.62:44525)
0809 18:56:36.940799 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.940801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.940920 (+ 119us) server_negotiation.cc:407] Connection header received
0809 18:56:36.940991 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.940991 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.941001 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.941045 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.941384 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.941864 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.942575 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.942788 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.942879 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.943732 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.943734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.943734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.943741 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.944991 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.945347 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.945349 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.945350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.945414 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.945668 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.945669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.945670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.945811 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.945923 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.946044 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.946125 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:56:36.946254 27791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.940682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:44525 (local address 127.23.229.3:58587)
0809 18:56:36.940866 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.940879 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.940936 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.941049 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.941050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.941242 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:36.941294 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.941295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.941965 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.941966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.942487 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.942488 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.942882 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.942883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.942958 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.943361 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:36.943365 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:36.943638 (+ 273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:36.945093 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.945094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.945095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.945272 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.945496 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:36.945497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:36.945498 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:36.945579 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:36.945890 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:36.945891 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:36.945943 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.946020 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.946142 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":70,"threads_started":1}
I20260809 18:56:36.946594 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:56:36 dist-test-slave-jq4t krb5kdc[26929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:36.971131 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.963853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39830 (local address 127.23.229.62:44525)
0809 18:56:36.963920 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.963922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.963929 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:56:36.963957 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.963958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.963968 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.964037 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.964715 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.965264 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.966051 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.966279 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.966333 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.968589 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.968590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.968591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.968597 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.970075 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.970418 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.970419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.970419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.970472 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.970668 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.970669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.970669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.970779 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.970871 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.970971 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.971062 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:56:36.973068 27000 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:36.974886 27000 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:36.982069 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.977741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36216 (local address 127.23.229.1:38853)
0809 18:56:36.977908 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.977913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.978224 (+ 311us) server_negotiation.cc:407] Connection header received
0809 18:56:36.978299 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.978302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.978317 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.978389 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:36.978587 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.979386 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.980833 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.981626 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.981710 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.981782 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.981924 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.981965 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260809 18:56:36.982064 27808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.977445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:44789 (local address 127.0.0.1:52102)
0809 18:56:36.977598 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.977646 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.977721 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.978367 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.978370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.978374 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:36.978457 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.978459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.979829 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.979830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.980881 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.980884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.981726 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.981727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.981814 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.981818 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.981891 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.981965 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":48,"thread_start_us":78,"threads_started":1}
I20260809 18:56:36.982242 27809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.977467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:38853 (local address 127.0.0.1:36216)
0809 18:56:36.978136 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.978145 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.978230 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.978462 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.978463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.978464 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:36.978500 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.978502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.979494 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.979495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.980745 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.980748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.981710 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.981711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.981795 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.981810 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.981889 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.982189 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"mutex_wait_us":36,"thread_start_us":108,"threads_started":1}
I20260809 18:56:36.982503 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.977954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52102 (local address 127.23.229.2:44789)
0809 18:56:36.978166 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.978170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.978180 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:56:36.978222 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.978223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.978242 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.978550 (+ 308us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:36.978609 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.979736 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.980968 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.981639 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.981947 (+ 308us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.982019 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.982045 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.982088 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":86,"threads_started":1}
I20260809 18:56:36.982893 27810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.977577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:33337 (local address 127.0.0.1:58538)
0809 18:56:36.978319 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:36.978328 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:36.978372 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:36.978671 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:36.978673 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:36.978675 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:36.978725 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.978727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.979971 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.979972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.981541 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:36.981542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.982639 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.982640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:36.982706 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.982710 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:36.982785 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 18:56:36.982824 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":91,"threads_started":1}
I20260809 18:56:36.982945 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.977740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58538 (local address 127.23.229.3:33337)
0809 18:56:36.977905 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.977911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.978438 (+ 527us) server_negotiation.cc:407] Connection header received
0809 18:56:36.978493 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.978495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.978508 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.978598 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:36.978815 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.979874 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.981639 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.982409 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.982548 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.982613 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.982801 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.982839 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260809 18:56:36.983094 27203 tablet_service.cc:1467] Processing CreateTablet for tablet ed65b5a593234f51bab403580f8e0b55 (DEFAULT_TABLE table=test-table [id=a0e6d0b7df074ae0b15e204a60ea67f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:36.983111 27431 tablet_service.cc:1467] Processing CreateTablet for tablet ed65b5a593234f51bab403580f8e0b55 (DEFAULT_TABLE table=test-table [id=a0e6d0b7df074ae0b15e204a60ea67f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:36.983491 27431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed65b5a593234f51bab403580f8e0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:36.983491 27203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed65b5a593234f51bab403580f8e0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:36.987437 27818 tablet_bootstrap.cc:492] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Bootstrap starting.
I20260809 18:56:36.988174 27818 tablet_bootstrap.cc:654] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:36.988083 27667 tablet_service.cc:1467] Processing CreateTablet for tablet ed65b5a593234f51bab403580f8e0b55 (DEFAULT_TABLE table=test-table [id=a0e6d0b7df074ae0b15e204a60ea67f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:36.988444 27667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed65b5a593234f51bab403580f8e0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:36.988587 27818 log.cc:824] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:36.988945 27817 tablet_bootstrap.cc:492] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Bootstrap starting.
I20260809 18:56:36.989399 27818 tablet_bootstrap.cc:492] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: No bootstrap required, opened a new log
I20260809 18:56:36.989480 27818 ts_tablet_manager.cc:1397] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:56:36.991582 27818 raft_consensus.cc:348] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:36.991775 27818 raft_consensus.cc:374] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:36.991820 27818 raft_consensus.cc:729] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4362bd41c472f85fabcd4f25dceb7, State: Initialized, Role: FOLLOWER
I20260809 18:56:36.991950 27818 consensus_queue.cc:260] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:36.992043 27826 tablet_bootstrap.cc:492] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Bootstrap starting.
I20260809 18:56:36.992280 27818 ts_tablet_manager.cc:1428] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:56:36.992316 27302 heartbeater.cc:503] Master 127.23.229.62:44525 was elected leader, sending a full tablet report...
I20260809 18:56:36.992916 27817 tablet_bootstrap.cc:654] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:36.993098 27826 tablet_bootstrap.cc:654] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:36.993331 27817 log.cc:824] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:36.993474 27826 log.cc:824] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:36.994108 27817 tablet_bootstrap.cc:492] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: No bootstrap required, opened a new log
I20260809 18:56:36.994199 27817 ts_tablet_manager.cc:1397] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 18:56:36.994249 27826 tablet_bootstrap.cc:492] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: No bootstrap required, opened a new log
I20260809 18:56:36.994342 27826 ts_tablet_manager.cc:1397] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:36.995884 27817 raft_consensus.cc:348] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:36.995918 27826 raft_consensus.cc:348] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:36.996035 27826 raft_consensus.cc:374] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:36.996038 27817 raft_consensus.cc:374] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:36.996057 27826 raft_consensus.cc:729] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Initialized, Role: FOLLOWER
I20260809 18:56:36.996088 27817 raft_consensus.cc:729] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32781598729e42c4a7229fc45fa0e1a5, State: Initialized, Role: FOLLOWER
I20260809 18:56:36.996205 27817 consensus_queue.cc:260] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:36.996205 27826 consensus_queue.cc:260] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:36.996556 27817 ts_tablet_manager.cc:1428] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:56:36.996563 27826 ts_tablet_manager.cc:1428] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:56:36.996564 27536 heartbeater.cc:503] Master 127.23.229.62:44525 was elected leader, sending a full tablet report...
I20260809 18:56:36.996680 27783 heartbeater.cc:503] Master 127.23.229.62:44525 was elected leader, sending a full tablet report...
W20260809 18:56:37.019424 27537 tablet.cc:2369] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:37.080740 27832 raft_consensus.cc:482] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:37.080878 27832 raft_consensus.cc:504] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:37.081317 27832 leader_election.cc:288] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789), eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853)
I20260809 18:56:37.084378 27833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.081565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:38853 (local address 127.23.229.3:58857)
0809 18:56:37.081860 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.081871 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.081929 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.082074 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.082074 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.082086 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:37.082153 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.082154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.082809 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.082810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.083541 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.083543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.084105 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.084106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.084189 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.084192 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.084235 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.084266 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":139,"thread_start_us":116,"threads_started":1}
I20260809 18:56:37.084409 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.081731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:58857 (local address 127.23.229.1:38853)
0809 18:56:37.081784 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.081786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.081944 (+ 158us) server_negotiation.cc:407] Connection header received
0809 18:56:37.081978 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.081979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.081988 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.082055 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:37.082219 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.082722 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.083642 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.084013 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.084072 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.084103 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.084266 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.084320 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:56:37.084506 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.081564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:44789 (local address 127.23.229.3:36899)
0809 18:56:37.081640 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.081655 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.081721 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.081889 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.081889 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.081892 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:37.081991 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.081992 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.082708 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.082709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.083536 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.083538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.084136 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.084137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.084244 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.084248 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.084308 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.084344 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":3}
I20260809 18:56:37.084702 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.081665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:36899 (local address 127.23.229.2:44789)
0809 18:56:37.081712 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.081713 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.081724 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:37.081782 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.081783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.081794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.081856 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:37.082079 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.082625 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.083637 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.084023 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.084115 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.084124 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.084333 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.084368 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:56:37.084915 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed65b5a593234f51bab403580f8e0b55" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7" is_pre_election: true
I20260809 18:56:37.085120 27230 raft_consensus.cc:2454] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:37.085101 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed65b5a593234f51bab403580f8e0b55" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5" is_pre_election: true
I20260809 18:56:37.085227 27459 raft_consensus.cc:2454] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:37.085368 27586 leader_election.cc:302] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, eef4362bd41c472f85fabcd4f25dceb7; no voters:
I20260809 18:56:37.085500 27832 raft_consensus.cc:2781] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:37.085551 27832 raft_consensus.cc:482] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:37.085568 27832 raft_consensus.cc:3037] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.086262 27832 raft_consensus.cc:504] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:37.086413 27832 leader_election.cc:288] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Requested vote from peers 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789), eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853)
I20260809 18:56:37.086553 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed65b5a593234f51bab403580f8e0b55" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5"
I20260809 18:56:37.086575 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed65b5a593234f51bab403580f8e0b55" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7"
I20260809 18:56:37.086655 27459 raft_consensus.cc:3037] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.086655 27230 raft_consensus.cc:3037] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.087396 27459 raft_consensus.cc:2454] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:37.087456 27230 raft_consensus.cc:2454] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:37.087970 27584 leader_election.cc:302] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, 32781598729e42c4a7229fc45fa0e1a5; no voters:
I20260809 18:56:37.088091 27832 raft_consensus.cc:2781] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:37.088289 27832 raft_consensus.cc:686] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Becoming Leader. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Running, Role: LEADER
I20260809 18:56:37.088394 27832 consensus_queue.cc:237] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } }
I20260809 18:56:37.089361 26999 catalog_manager.cc:5495] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3). New cstate: current_term: 1 leader_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } health_report { overall_health: UNKNOWN } } }
W20260809 18:56:37.090148 27303 tablet.cc:2369] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:56:37 dist-test-slave-jq4t krb5kdc[26929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:37.128839 27842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.121335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:44525 (local address 127.0.0.1:39844)
0809 18:56:37.121574 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.121585 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.121679 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.121832 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.121833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.122188 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:37.122244 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.122247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.122952 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.122953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.123493 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.123494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.123853 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.123854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.123910 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.124540 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:37.124545 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:37.126036 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:37.127586 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:37.127594 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:37.127596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:37.127824 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:37.128158 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:37.128159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:37.128160 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:37.128227 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:37.128465 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:37.128472 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:37.128598 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.128657 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.128761 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":139,"threads_started":1}
I20260809 18:56:37.128964 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.121412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39844 (local address 127.23.229.62:44525)
0809 18:56:37.121506 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.121510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.121661 (+ 151us) server_negotiation.cc:407] Connection header received
0809 18:56:37.121738 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.121739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.121753 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.121826 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:37.122341 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.122855 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.123582 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.123768 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.123842 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.126153 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:37.126155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:37.126155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:37.126162 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:37.127487 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:37.127930 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:37.127932 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:37.127932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:37.127990 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:37.128293 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:37.128294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:37.128294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:37.128405 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:37.128458 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.128694 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.128832 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":39}
I20260809 18:56:37.131031 26999 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:39844:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:56:37.131224 26999 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:37.132944 27431 tablet_service.cc:1467] Processing CreateTablet for tablet 0116044adcde4a1db0e3560704c9f49d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b3ad144d943e43ee804ebcf1cb3bc2e9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:37.132969 27667 tablet_service.cc:1467] Processing CreateTablet for tablet 0116044adcde4a1db0e3560704c9f49d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b3ad144d943e43ee804ebcf1cb3bc2e9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:37.132958 27203 tablet_service.cc:1467] Processing CreateTablet for tablet 0116044adcde4a1db0e3560704c9f49d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b3ad144d943e43ee804ebcf1cb3bc2e9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:37.133105 27431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0116044adcde4a1db0e3560704c9f49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:37.133132 27203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0116044adcde4a1db0e3560704c9f49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:37.133132 27667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0116044adcde4a1db0e3560704c9f49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:37.134320 27817 tablet_bootstrap.cc:492] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: Bootstrap starting.
I20260809 18:56:37.134706 27826 tablet_bootstrap.cc:492] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: Bootstrap starting.
I20260809 18:56:37.134862 27818 tablet_bootstrap.cc:492] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: Bootstrap starting.
I20260809 18:56:37.135053 27817 tablet_bootstrap.cc:654] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:37.135216 27826 tablet_bootstrap.cc:654] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:37.135303 27818 tablet_bootstrap.cc:654] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:37.135795 27817 tablet_bootstrap.cc:492] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: No bootstrap required, opened a new log
I20260809 18:56:37.135856 27817 ts_tablet_manager.cc:1397] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:37.135974 27818 tablet_bootstrap.cc:492] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: No bootstrap required, opened a new log
I20260809 18:56:37.136041 27818 ts_tablet_manager.cc:1397] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:37.136034 27817 raft_consensus.cc:348] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.136147 27817 raft_consensus.cc:374] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:37.136178 27817 raft_consensus.cc:729] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32781598729e42c4a7229fc45fa0e1a5, State: Initialized, Role: FOLLOWER
I20260809 18:56:37.136232 27817 consensus_queue.cc:260] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.136217 27818 raft_consensus.cc:348] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.136308 27818 raft_consensus.cc:374] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:37.136339 27818 raft_consensus.cc:729] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4362bd41c472f85fabcd4f25dceb7, State: Initialized, Role: FOLLOWER
I20260809 18:56:37.136365 27817 ts_tablet_manager.cc:1428] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:37.136394 27818 consensus_queue.cc:260] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.136437 27831 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.136574 27831 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:37.136598 27827 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.136678 27827 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:37.136792 27818 ts_tablet_manager.cc:1428] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:37.136812 27826 tablet_bootstrap.cc:492] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: No bootstrap required, opened a new log
I20260809 18:56:37.136878 27826 ts_tablet_manager.cc:1397] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:37.137045 27826 raft_consensus.cc:348] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.137148 27826 raft_consensus.cc:374] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:37.137177 27826 raft_consensus.cc:729] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Initialized, Role: FOLLOWER
I20260809 18:56:37.137229 27826 consensus_queue.cc:260] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.137337 27826 ts_tablet_manager.cc:1428] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:37.137593 27832 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.137686 27832 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:37.139775 27831 raft_consensus.cc:482] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:37.139870 27831 raft_consensus.cc:504] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.140246 27831 leader_election.cc:288] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3:33337)
I20260809 18:56:37.143280 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.140518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:52207 (local address 127.23.229.1:38853)
0809 18:56:37.140570 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.140572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.140581 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:37.140607 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.140608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.140621 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.140685 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:37.140871 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.141369 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.142403 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.142909 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.142995 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.143006 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.143177 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.143213 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:56:37.143280 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.140382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:38853 (local address 127.23.229.2:52207)
0809 18:56:37.140444 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.140456 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.140542 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.140700 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.140701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.140703 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:37.140779 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.140780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.141463 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.141464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.142311 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.142313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.142994 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.142995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.143089 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.143091 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.143168 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.143210 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":2}
I20260809 18:56:37.143371 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.140684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:42923 (local address 127.23.229.3:33337)
0809 18:56:37.140749 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.140751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.140759 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:37.140826 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.140827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.140835 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.140888 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:37.141039 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.141496 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.142480 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.143005 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.143098 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.143109 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.143273 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.143308 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:56:37.143391 27852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.140412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:33337 (local address 127.23.229.2:42923)
0809 18:56:37.140705 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.140717 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.140765 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.140892 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.140893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.140895 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:37.140959 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.140961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.141580 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.141582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.142331 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.142332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.143117 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.143119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.143196 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.143199 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.143267 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.143308 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":2,"thread_start_us":158,"threads_started":1}
I20260809 18:56:37.143659 27700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0116044adcde4a1db0e3560704c9f49d" candidate_uuid: "32781598729e42c4a7229fc45fa0e1a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" is_pre_election: true
I20260809 18:56:37.143723 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0116044adcde4a1db0e3560704c9f49d" candidate_uuid: "32781598729e42c4a7229fc45fa0e1a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7" is_pre_election: true
I20260809 18:56:37.143781 27700 raft_consensus.cc:2454] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32781598729e42c4a7229fc45fa0e1a5 in term 0.
I20260809 18:56:37.143793 27230 raft_consensus.cc:2454] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32781598729e42c4a7229fc45fa0e1a5 in term 0.
I20260809 18:56:37.144004 27353 leader_election.cc:302] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, 32781598729e42c4a7229fc45fa0e1a5; no voters:
I20260809 18:56:37.144157 27831 raft_consensus.cc:2781] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:37.144230 27831 raft_consensus.cc:482] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:37.144263 27831 raft_consensus.cc:3037] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.145067 27831 raft_consensus.cc:504] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.145226 27831 leader_election.cc:288] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [CANDIDATE]: Term 1 election: Requested vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3:33337)
I20260809 18:56:37.145375 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0116044adcde4a1db0e3560704c9f49d" candidate_uuid: "32781598729e42c4a7229fc45fa0e1a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7"
I20260809 18:56:37.145411 27700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0116044adcde4a1db0e3560704c9f49d" candidate_uuid: "32781598729e42c4a7229fc45fa0e1a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0394fee9cad54c0a925eacdc3f52f6ba"
I20260809 18:56:37.145462 27230 raft_consensus.cc:3037] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.145494 27700 raft_consensus.cc:3037] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.146168 27230 raft_consensus.cc:2454] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32781598729e42c4a7229fc45fa0e1a5 in term 1.
I20260809 18:56:37.146277 27700 raft_consensus.cc:2454] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32781598729e42c4a7229fc45fa0e1a5 in term 1.
I20260809 18:56:37.146343 27348 leader_election.cc:302] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32781598729e42c4a7229fc45fa0e1a5, eef4362bd41c472f85fabcd4f25dceb7; no voters:
I20260809 18:56:37.146446 27831 raft_consensus.cc:2781] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:37.146616 27831 raft_consensus.cc:686] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [term 1 LEADER]: Becoming Leader. State: Replica: 32781598729e42c4a7229fc45fa0e1a5, State: Running, Role: LEADER
I20260809 18:56:37.146736 27831 consensus_queue.cc:237] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.147226 27853 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: TxnStatusTablet state changed. Reason: New leader 32781598729e42c4a7229fc45fa0e1a5. Latest consensus state: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.147325 27853 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:37.147507 27856 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:56:37.147622 27856 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:56:37.147634 26999 catalog_manager.cc:5495] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2). New cstate: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:37.154984 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.152559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52108 (local address 127.23.229.2:44789)
0809 18:56:37.152598 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.152600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.152609 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:37.152689 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.152690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.152707 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.152771 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:37.152918 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.153406 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.154176 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.154390 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.154468 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.154653 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:37.154755 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:37.154843 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.154903 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.154923 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:56:37.155026 27842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.152445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:44789 (local address 127.0.0.1:52108)
0809 18:56:37.152548 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.152561 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.152618 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.152777 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.152778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.152779 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:37.152830 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.152832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.153493 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.153494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.154086 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.154088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.154467 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.154468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.154535 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.154554 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:37.154823 (+ 269us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:37.154841 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.154899 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.154949 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 18:56:37.156649 27230 raft_consensus.cc:1261] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Refusing update from remote peer 32781598729e42c4a7229fc45fa0e1a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:37.156683 27700 raft_consensus.cc:1261] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Refusing update from remote peer 32781598729e42c4a7229fc45fa0e1a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:37.157021 27831 consensus_queue.cc:1035] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:37.157152 27853 consensus_queue.cc:1035] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:37.158303 27832 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: TxnStatusTablet state changed. Reason: New leader 32781598729e42c4a7229fc45fa0e1a5. Latest consensus state: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.158414 27832 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:37.158524 27827 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: TxnStatusTablet state changed. Reason: New leader 32781598729e42c4a7229fc45fa0e1a5. Latest consensus state: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.158607 27827 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:37.159564 27831 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.159650 27831 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:37.159806 27832 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.159895 27832 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P 0394fee9cad54c0a925eacdc3f52f6ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:37.160072 27860 mvcc.cc:205] Tried to move back new op lower bound from 7316692161150959616 to 7316692161113530368. Current Snapshot: MvccSnapshot[applied={T|T < 7316692161150959616}]
I20260809 18:56:37.160594 27863 mvcc.cc:205] Tried to move back new op lower bound from 7316692161150959616 to 7316692161113530368. Current Snapshot: MvccSnapshot[applied={T|T < 7316692161150959616}]
I20260809 18:56:37.161464 27831 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.161569 27831 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P 32781598729e42c4a7229fc45fa0e1a5: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:37.161700 27827 tablet_replica.cc:439] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "32781598729e42c4a7229fc45fa0e1a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } } }
I20260809 18:56:37.161788 27861 mvcc.cc:205] Tried to move back new op lower bound from 7316692161150959616 to 7316692161113530368. Current Snapshot: MvccSnapshot[applied={T|T < 7316692161150959616}]
I20260809 18:56:37.161809 27827 tablet_replica.cc:442] T 0116044adcde4a1db0e3560704c9f49d P eef4362bd41c472f85fabcd4f25dceb7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:37.165657 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.162682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58540 (local address 127.23.229.3:33337)
0809 18:56:37.162724 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.162726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.162736 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:56:37.162803 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.162804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.162823 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.162903 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:37.163037 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.163812 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.164748 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.165038 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.165127 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.165314 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:37.165432 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:37.165530 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.165587 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.165607 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:56:37.170647 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.168356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:41023 (local address 127.23.229.2:44789)
0809 18:56:37.168400 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.168402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.168410 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:37.168460 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.168461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.168498 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.168555 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:37.168708 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.169171 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.169935 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.170128 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.170200 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.170396 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:37.170434 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:37.170496 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.170558 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.170577 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:56:37.170655 27791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.168244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:44789 (local address 127.23.229.3:41023)
0809 18:56:37.168338 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.168352 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.168400 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.168559 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.168560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.168561 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:37.168624 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.168625 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.169258 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.169259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.169842 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.169844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.170213 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.170214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.170280 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.170297 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:37.170498 (+ 201us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:37.170500 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.170553 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.170593 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 18:56:37.173592 27459 raft_consensus.cc:1261] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:37.173779 27230 raft_consensus.cc:1261] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:37.174074 27834 consensus_queue.cc:1035] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:37.174190 27832 consensus_queue.cc:1035] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:37.183869 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.181099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:33337 (local address 127.23.229.2:43219)
0809 18:56:37.181171 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.181184 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.181226 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.181374 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.181374 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.181375 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:37.181441 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.181442 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.182088 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.182089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.182910 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.182913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.183388 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.183388 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.183464 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.183485 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:37.183695 (+ 210us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:37.183698 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.183740 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.183789 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 18:56:37.183861 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.181222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43219 (local address 127.23.229.3:33337)
0809 18:56:37.181265 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.181268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.181274 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:56:37.181296 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.181297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.181308 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.181370 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:37.181521 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.182003 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.182990 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.183310 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.183383 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.183564 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:37.183610 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:37.183691 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.183753 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.183777 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:56:37.194012 27000 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:37.194149 27000 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:37.195010 27000 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Sending DeleteTablet for 3 replicas of tablet ed65b5a593234f51bab403580f8e0b55
I20260809 18:56:37.195362 27431 tablet_service.cc:1514] Processing DeleteTablet for tablet ed65b5a593234f51bab403580f8e0b55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:37 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:52102
I20260809 18:56:37.195456 27203 tablet_service.cc:1514] Processing DeleteTablet for tablet ed65b5a593234f51bab403580f8e0b55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:37 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:36216
I20260809 18:56:37.195636 27667 tablet_service.cc:1514] Processing DeleteTablet for tablet ed65b5a593234f51bab403580f8e0b55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:37 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:58538
I20260809 18:56:37.195914 27000 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:37.196081 27000 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:37.196009 27889 tablet_replica.cc:330] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: stopping tablet replica
I20260809 18:56:37.196460 27891 tablet_replica.cc:330] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: stopping tablet replica
I20260809 18:56:37.196588 27891 raft_consensus.cc:2229] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:37.196687 27891 raft_consensus.cc:2258] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:37.196839 27890 tablet_replica.cc:330] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: stopping tablet replica
I20260809 18:56:37.196936 27890 raft_consensus.cc:2229] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:37.196985 27890 raft_consensus.cc:2258] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:37.197446 27891 ts_tablet_manager.cc:1905] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:37.198256 27667 tablet_service.cc:1467] Processing CreateTablet for tablet 065bfea1eb494564a971e8f6ec9919aa (DEFAULT_TABLE table=test-table [id=733e76322c5b4be2848e38e0c3499770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:37.198393 27667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 065bfea1eb494564a971e8f6ec9919aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:37.199268 27891 ts_tablet_manager.cc:1918] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:37.199333 27891 log.cc:1196] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/ed65b5a593234f51bab403580f8e0b55
I20260809 18:56:37.199604 27891 ts_tablet_manager.cc:1939] T ed65b5a593234f51bab403580f8e0b55 P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting consensus metadata
I20260809 18:56:37.199766 27826 tablet_bootstrap.cc:492] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: Bootstrap starting.
I20260809 18:56:37.200181 27826 tablet_bootstrap.cc:654] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:37.200354 27890 ts_tablet_manager.cc:1905] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:37.200644 26979 catalog_manager.cc:4841] TS 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3:33337): tablet ed65b5a593234f51bab403580f8e0b55 (table test-table [id=a0e6d0b7df074ae0b15e204a60ea67f0]) successfully deleted
I20260809 18:56:37.201175 27203 tablet_service.cc:1467] Processing CreateTablet for tablet 065bfea1eb494564a971e8f6ec9919aa (DEFAULT_TABLE table=test-table [id=733e76322c5b4be2848e38e0c3499770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:37.201287 27203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 065bfea1eb494564a971e8f6ec9919aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:37.198194 27431 tablet_service.cc:1467] Processing CreateTablet for tablet 065bfea1eb494564a971e8f6ec9919aa (DEFAULT_TABLE table=test-table [id=733e76322c5b4be2848e38e0c3499770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:37.201606 27431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 065bfea1eb494564a971e8f6ec9919aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:37.202468 27818 tablet_bootstrap.cc:492] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: Bootstrap starting.
I20260809 18:56:37.202855 27818 tablet_bootstrap.cc:654] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:37.203022 27817 tablet_bootstrap.cc:492] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: Bootstrap starting.
I20260809 18:56:37.196365 27889 raft_consensus.cc:2229] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:37.203461 27817 tablet_bootstrap.cc:654] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:37.203454 27889 raft_consensus.cc:2258] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:37.204366 27826 tablet_bootstrap.cc:492] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: No bootstrap required, opened a new log
I20260809 18:56:37.204419 27826 ts_tablet_manager.cc:1397] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 18:56:37.204428 27889 ts_tablet_manager.cc:1905] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:37.204542 27890 ts_tablet_manager.cc:1918] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:37.204619 27890 log.cc:1196] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/ed65b5a593234f51bab403580f8e0b55
I20260809 18:56:37.204680 27826 raft_consensus.cc:348] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.204761 27826 raft_consensus.cc:374] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:37.204782 27826 raft_consensus.cc:729] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Initialized, Role: FOLLOWER
I20260809 18:56:37.204828 27826 consensus_queue.cc:260] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.204898 27890 ts_tablet_manager.cc:1939] T ed65b5a593234f51bab403580f8e0b55 P eef4362bd41c472f85fabcd4f25dceb7: Deleting consensus metadata
I20260809 18:56:37.204914 27826 ts_tablet_manager.cc:1428] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.205334 26978 catalog_manager.cc:4841] TS eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853): tablet ed65b5a593234f51bab403580f8e0b55 (table test-table [id=a0e6d0b7df074ae0b15e204a60ea67f0]) successfully deleted
I20260809 18:56:37.206174 27889 ts_tablet_manager.cc:1918] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:37.206272 27889 log.cc:1196] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/ed65b5a593234f51bab403580f8e0b55
I20260809 18:56:37.206277 27817 tablet_bootstrap.cc:492] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: No bootstrap required, opened a new log
I20260809 18:56:37.206365 27817 ts_tablet_manager.cc:1397] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 18:56:37.206511 27817 raft_consensus.cc:348] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.206624 27817 raft_consensus.cc:374] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:37.206652 27817 raft_consensus.cc:729] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32781598729e42c4a7229fc45fa0e1a5, State: Initialized, Role: FOLLOWER
I20260809 18:56:37.206696 27817 consensus_queue.cc:260] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.206792 27817 ts_tablet_manager.cc:1428] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.206561 27889 ts_tablet_manager.cc:1939] T ed65b5a593234f51bab403580f8e0b55 P 32781598729e42c4a7229fc45fa0e1a5: Deleting consensus metadata
I20260809 18:56:37.207527 26977 catalog_manager.cc:4841] TS 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789): tablet ed65b5a593234f51bab403580f8e0b55 (table test-table [id=a0e6d0b7df074ae0b15e204a60ea67f0]) successfully deleted
I20260809 18:56:37.208825 27818 tablet_bootstrap.cc:492] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: No bootstrap required, opened a new log
I20260809 18:56:37.208884 27818 ts_tablet_manager.cc:1397] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260809 18:56:37.209031 27818 raft_consensus.cc:348] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.209105 27818 raft_consensus.cc:374] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:37.209126 27818 raft_consensus.cc:729] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4362bd41c472f85fabcd4f25dceb7, State: Initialized, Role: FOLLOWER
I20260809 18:56:37.209175 27818 consensus_queue.cc:260] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.209264 27818 ts_tablet_manager.cc:1428] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:37.252450 27882 raft_consensus.cc:482] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:37.252615 27882 raft_consensus.cc:504] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.252801 27882 leader_election.cc:288] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789)
I20260809 18:56:37.253084 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "065bfea1eb494564a971e8f6ec9919aa" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5" is_pre_election: true
I20260809 18:56:37.253090 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "065bfea1eb494564a971e8f6ec9919aa" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7" is_pre_election: true
I20260809 18:56:37.253181 27459 raft_consensus.cc:2454] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:37.253214 27230 raft_consensus.cc:2454] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:37.253440 27586 leader_election.cc:302] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, eef4362bd41c472f85fabcd4f25dceb7; no voters:
I20260809 18:56:37.253582 27882 raft_consensus.cc:2781] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:37.253618 27882 raft_consensus.cc:482] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:37.253636 27882 raft_consensus.cc:3037] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.254551 27882 raft_consensus.cc:504] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.254689 27882 leader_election.cc:288] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Requested vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789)
I20260809 18:56:37.254889 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "065bfea1eb494564a971e8f6ec9919aa" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5"
I20260809 18:56:37.254998 27459 raft_consensus.cc:3037] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.254956 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "065bfea1eb494564a971e8f6ec9919aa" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7"
I20260809 18:56:37.255048 27230 raft_consensus.cc:3037] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:37.255841 27459 raft_consensus.cc:2454] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:37.255883 27230 raft_consensus.cc:2454] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:37.256036 27584 leader_election.cc:302] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, 32781598729e42c4a7229fc45fa0e1a5; no voters:
I20260809 18:56:37.256127 27882 raft_consensus.cc:2781] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:37.256168 27882 raft_consensus.cc:686] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Becoming Leader. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Running, Role: LEADER
I20260809 18:56:37.256212 27882 consensus_queue.cc:237] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:37.256795 27000 catalog_manager.cc:5495] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3). New cstate: current_term: 1 leader_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:37.264775 27230 raft_consensus.cc:1261] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:37.264856 27459 raft_consensus.cc:1261] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:37.265031 27832 consensus_queue.cc:1035] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:37.265125 27882 consensus_queue.cc:1035] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:56:37.272668 27863 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 18:56:38.795331 26999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:38.795444 26999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:38.796424 26999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Sending DeleteTablet for 3 replicas of tablet 065bfea1eb494564a971e8f6ec9919aa
I20260809 18:56:38.796756 27667 tablet_service.cc:1514] Processing DeleteTablet for tablet 065bfea1eb494564a971e8f6ec9919aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:38 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:58538
I20260809 18:56:38.796759 27430 tablet_service.cc:1514] Processing DeleteTablet for tablet 065bfea1eb494564a971e8f6ec9919aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:38 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:52102
I20260809 18:56:38.796784 27203 tablet_service.cc:1514] Processing DeleteTablet for tablet 065bfea1eb494564a971e8f6ec9919aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:38 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:36216
I20260809 18:56:38.797226 27934 tablet_replica.cc:330] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: stopping tablet replica
I20260809 18:56:38.797297 27934 raft_consensus.cc:2229] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:38.797338 27934 raft_consensus.cc:2258] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:38.797463 27931 tablet_replica.cc:330] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: stopping tablet replica
I20260809 18:56:38.797533 27931 raft_consensus.cc:2229] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:38.797581 27931 raft_consensus.cc:2258] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:38.797809 27934 ts_tablet_manager.cc:1905] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:38.799875 27934 ts_tablet_manager.cc:1918] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:38.799950 27934 log.cc:1196] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/065bfea1eb494564a971e8f6ec9919aa
I20260809 18:56:38.800185 27934 ts_tablet_manager.cc:1939] T 065bfea1eb494564a971e8f6ec9919aa P 32781598729e42c4a7229fc45fa0e1a5: Deleting consensus metadata
I20260809 18:56:38.800387 27933 tablet_replica.cc:330] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: stopping tablet replica
I20260809 18:56:38.800457 27933 raft_consensus.cc:2229] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:38.800608 26977 catalog_manager.cc:4841] TS 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789): tablet 065bfea1eb494564a971e8f6ec9919aa (table test-table [id=733e76322c5b4be2848e38e0c3499770]) successfully deleted
I20260809 18:56:38.800661 27933 raft_consensus.cc:2258] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:38.800952 27931 ts_tablet_manager.cc:1905] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:38.802819 27931 ts_tablet_manager.cc:1918] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:38.802886 27931 log.cc:1196] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/065bfea1eb494564a971e8f6ec9919aa
I20260809 18:56:38.803129 27931 ts_tablet_manager.cc:1939] T 065bfea1eb494564a971e8f6ec9919aa P eef4362bd41c472f85fabcd4f25dceb7: Deleting consensus metadata
I20260809 18:56:38.803544 26978 catalog_manager.cc:4841] TS eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853): tablet 065bfea1eb494564a971e8f6ec9919aa (table test-table [id=733e76322c5b4be2848e38e0c3499770]) successfully deleted
I20260809 18:56:38.803589 27933 ts_tablet_manager.cc:1905] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:38.805243 27933 ts_tablet_manager.cc:1918] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:38.805323 27933 log.cc:1196] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/065bfea1eb494564a971e8f6ec9919aa
I20260809 18:56:38.805586 27933 ts_tablet_manager.cc:1939] T 065bfea1eb494564a971e8f6ec9919aa P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting consensus metadata
I20260809 18:56:38.805953 26979 catalog_manager.cc:4841] TS 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3:33337): tablet 065bfea1eb494564a971e8f6ec9919aa (table test-table [id=733e76322c5b4be2848e38e0c3499770]) successfully deleted
Aug 09 18:56:38 dist-test-slave-jq4t krb5kdc[26929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:56:38 dist-test-slave-jq4t krb5kdc[26929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:38.823793 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:38.815862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.23.229.62:44525)
0809 18:56:38.816025 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:38.816027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:38.816041 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:56:38.816132 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:38.816133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:38.816145 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:38.816219 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:38.816918 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.817541 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.818384 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.818600 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.818665 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:38.821125 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:38.821127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:38.821127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:38.821135 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:38.822746 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.823117 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.823118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.823119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.823179 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.823349 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.823350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.823350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.823473 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:38.823553 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:38.823640 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 18:56:38.823715 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":104,"threads_started":1}
I20260809 18:56:38.825615 26999 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:38.825810 26999 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:38.827487 27203 tablet_service.cc:1467] Processing CreateTablet for tablet eb85cb0c39514e10a6c619fcc1dcf79b (DEFAULT_TABLE table=test-table [id=92985c75eafe46028d11d1bfb4e40b7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:38.827546 27430 tablet_service.cc:1467] Processing CreateTablet for tablet eb85cb0c39514e10a6c619fcc1dcf79b (DEFAULT_TABLE table=test-table [id=92985c75eafe46028d11d1bfb4e40b7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:38.827657 27203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb85cb0c39514e10a6c619fcc1dcf79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:38.827662 27430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb85cb0c39514e10a6c619fcc1dcf79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:38.829241 27949 tablet_bootstrap.cc:492] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: Bootstrap starting.
I20260809 18:56:38.829370 27667 tablet_service.cc:1467] Processing CreateTablet for tablet eb85cb0c39514e10a6c619fcc1dcf79b (DEFAULT_TABLE table=test-table [id=92985c75eafe46028d11d1bfb4e40b7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:38.829517 27667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb85cb0c39514e10a6c619fcc1dcf79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:38.829676 27949 tablet_bootstrap.cc:654] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:38.830017 27948 tablet_bootstrap.cc:492] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: Bootstrap starting.
I20260809 18:56:38.830363 27949 tablet_bootstrap.cc:492] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: No bootstrap required, opened a new log
I20260809 18:56:38.830441 27948 tablet_bootstrap.cc:654] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:38.830519 27949 ts_tablet_manager.cc:1397] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:38.830674 27949 raft_consensus.cc:348] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:38.830767 27949 raft_consensus.cc:374] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:38.830789 27949 raft_consensus.cc:729] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32781598729e42c4a7229fc45fa0e1a5, State: Initialized, Role: FOLLOWER
I20260809 18:56:38.830853 27949 consensus_queue.cc:260] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:38.830951 27949 ts_tablet_manager.cc:1428] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:38.831290 27956 tablet_bootstrap.cc:492] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Bootstrap starting.
I20260809 18:56:38.831399 27948 tablet_bootstrap.cc:492] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: No bootstrap required, opened a new log
I20260809 18:56:38.831454 27948 ts_tablet_manager.cc:1397] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:38.831580 27948 raft_consensus.cc:348] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:38.831669 27948 raft_consensus.cc:374] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:38.831696 27948 raft_consensus.cc:729] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4362bd41c472f85fabcd4f25dceb7, State: Initialized, Role: FOLLOWER
I20260809 18:56:38.831732 27956 tablet_bootstrap.cc:654] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:38.831770 27948 consensus_queue.cc:260] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:38.832005 27948 ts_tablet_manager.cc:1428] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:38.832576 27956 tablet_bootstrap.cc:492] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: No bootstrap required, opened a new log
I20260809 18:56:38.832638 27956 ts_tablet_manager.cc:1397] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:38.832782 27956 raft_consensus.cc:348] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:38.832859 27956 raft_consensus.cc:374] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:38.832881 27956 raft_consensus.cc:729] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Initialized, Role: FOLLOWER
I20260809 18:56:38.832933 27956 consensus_queue.cc:260] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:38.833055 27956 ts_tablet_manager.cc:1428] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260809 18:56:38.938251 27784 tablet.cc:2369] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:39.094801 27924 raft_consensus.cc:482] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:39.094972 27924 raft_consensus.cc:504] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.095227 27924 leader_election.cc:288] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789)
I20260809 18:56:39.095517 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb85cb0c39514e10a6c619fcc1dcf79b" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7" is_pre_election: true
I20260809 18:56:39.095533 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb85cb0c39514e10a6c619fcc1dcf79b" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5" is_pre_election: true
I20260809 18:56:39.095651 27230 raft_consensus.cc:2454] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:39.095647 27459 raft_consensus.cc:2454] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:39.095858 27584 leader_election.cc:302] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, 32781598729e42c4a7229fc45fa0e1a5; no voters:
I20260809 18:56:39.096011 27924 raft_consensus.cc:2781] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:39.096066 27924 raft_consensus.cc:482] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:39.096091 27924 raft_consensus.cc:3037] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:39.096891 27924 raft_consensus.cc:504] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.097064 27924 leader_election.cc:288] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Requested vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789)
I20260809 18:56:39.097254 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb85cb0c39514e10a6c619fcc1dcf79b" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7"
I20260809 18:56:39.097363 27230 raft_consensus.cc:3037] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:39.097332 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb85cb0c39514e10a6c619fcc1dcf79b" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5"
I20260809 18:56:39.097441 27459 raft_consensus.cc:3037] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:39.098035 27230 raft_consensus.cc:2454] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:39.098086 27459 raft_consensus.cc:2454] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:39.098287 27586 leader_election.cc:302] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, eef4362bd41c472f85fabcd4f25dceb7; no voters:
I20260809 18:56:39.098409 27924 raft_consensus.cc:2781] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:39.098491 27924 raft_consensus.cc:686] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Becoming Leader. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Running, Role: LEADER
I20260809 18:56:39.098587 27924 consensus_queue.cc:237] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.099337 26999 catalog_manager.cc:5495] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3). New cstate: current_term: 1 leader_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:39.118906 27964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:39.116330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58556 (local address 127.23.229.3:33337)
0809 18:56:39.116519 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:39.116521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:39.116530 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:39.116555 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:39.116556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:39.116568 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:39.116662 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:39.116825 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:39.117356 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:39.118143 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:39.118369 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:39.118451 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:39.118614 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:39.118652 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:39.118724 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:39.118785 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 18:56:39.118809 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
I20260809 18:56:39.121374 27459 raft_consensus.cc:1261] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:39.121403 27230 raft_consensus.cc:1261] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:39.121680 27919 consensus_queue.cc:1035] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:39.121785 27924 consensus_queue.cc:1035] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:39.132234 26999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:39.132340 26999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:39.132964 26999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Sending DeleteTablet for 3 replicas of tablet eb85cb0c39514e10a6c619fcc1dcf79b
I20260809 18:56:39.133234 27430 tablet_service.cc:1514] Processing DeleteTablet for tablet eb85cb0c39514e10a6c619fcc1dcf79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:39 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:52102
I20260809 18:56:39.133239 27667 tablet_service.cc:1514] Processing DeleteTablet for tablet eb85cb0c39514e10a6c619fcc1dcf79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:39 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:58538
I20260809 18:56:39.133251 27203 tablet_service.cc:1514] Processing DeleteTablet for tablet eb85cb0c39514e10a6c619fcc1dcf79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:39 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:36216
I20260809 18:56:39.133332 27934 tablet_replica.cc:330] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: stopping tablet replica
I20260809 18:56:39.133390 27934 raft_consensus.cc:2229] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:39.133443 27934 raft_consensus.cc:2258] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:39.133472 26999 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 18:56:39.133534 27931 tablet_replica.cc:330] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: stopping tablet replica
W20260809 18:56:39.133581 26999 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:39.133596 27931 raft_consensus.cc:2229] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:39.133634 27931 raft_consensus.cc:2258] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:39.133728 27933 tablet_replica.cc:330] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: stopping tablet replica
I20260809 18:56:39.133785 27933 raft_consensus.cc:2229] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:39.133841 27933 raft_consensus.cc:2258] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:39.134140 27933 ts_tablet_manager.cc:1905] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:39.134250 27934 ts_tablet_manager.cc:1905] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:39.134267 27931 ts_tablet_manager.cc:1905] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:39.135950 27934 ts_tablet_manager.cc:1918] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:39.136049 27934 log.cc:1196] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/eb85cb0c39514e10a6c619fcc1dcf79b
I20260809 18:56:39.136159 27203 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd491abe9824a4e9d1e9cae07af9c86 (DEFAULT_TABLE table=test-table [id=7ba62eb8767e496ea0af5e7acfa43371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:39.136183 27667 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd491abe9824a4e9d1e9cae07af9c86 (DEFAULT_TABLE table=test-table [id=7ba62eb8767e496ea0af5e7acfa43371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:39.136310 27934 ts_tablet_manager.cc:1939] T eb85cb0c39514e10a6c619fcc1dcf79b P 32781598729e42c4a7229fc45fa0e1a5: Deleting consensus metadata
I20260809 18:56:39.136364 27931 ts_tablet_manager.cc:1918] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:39.136371 27203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd491abe9824a4e9d1e9cae07af9c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:39.136427 27931 log.cc:1196] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/eb85cb0c39514e10a6c619fcc1dcf79b
I20260809 18:56:39.136677 27931 ts_tablet_manager.cc:1939] T eb85cb0c39514e10a6c619fcc1dcf79b P eef4362bd41c472f85fabcd4f25dceb7: Deleting consensus metadata
I20260809 18:56:39.136672 27430 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd491abe9824a4e9d1e9cae07af9c86 (DEFAULT_TABLE table=test-table [id=7ba62eb8767e496ea0af5e7acfa43371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:39.136713 26977 catalog_manager.cc:4841] TS 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789): tablet eb85cb0c39514e10a6c619fcc1dcf79b (table test-table [id=92985c75eafe46028d11d1bfb4e40b7b]) successfully deleted
I20260809 18:56:39.136772 27430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd491abe9824a4e9d1e9cae07af9c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:39.137012 26978 catalog_manager.cc:4841] TS eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853): tablet eb85cb0c39514e10a6c619fcc1dcf79b (table test-table [id=92985c75eafe46028d11d1bfb4e40b7b]) successfully deleted
I20260809 18:56:39.137586 27948 tablet_bootstrap.cc:492] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7: Bootstrap starting.
I20260809 18:56:39.137945 27949 tablet_bootstrap.cc:492] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: Bootstrap starting.
I20260809 18:56:39.138026 27933 ts_tablet_manager.cc:1918] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:39.138041 27948 tablet_bootstrap.cc:654] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:39.138083 27933 log.cc:1196] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/eb85cb0c39514e10a6c619fcc1dcf79b
I20260809 18:56:39.138273 27933 ts_tablet_manager.cc:1939] T eb85cb0c39514e10a6c619fcc1dcf79b P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting consensus metadata
I20260809 18:56:39.138284 27949 tablet_bootstrap.cc:654] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:39.138784 27667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd491abe9824a4e9d1e9cae07af9c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:39.138993 27949 tablet_bootstrap.cc:492] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: No bootstrap required, opened a new log
I20260809 18:56:39.139047 27949 ts_tablet_manager.cc:1397] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:39.139168 27949 raft_consensus.cc:348] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.139240 27949 raft_consensus.cc:374] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:39.139254 27949 raft_consensus.cc:729] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32781598729e42c4a7229fc45fa0e1a5, State: Initialized, Role: FOLLOWER
I20260809 18:56:39.139312 27949 consensus_queue.cc:260] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.139415 27949 ts_tablet_manager.cc:1428] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:39.140185 27956 tablet_bootstrap.cc:492] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: Bootstrap starting.
I20260809 18:56:39.140434 26979 catalog_manager.cc:4841] TS 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3:33337): tablet eb85cb0c39514e10a6c619fcc1dcf79b (table test-table [id=92985c75eafe46028d11d1bfb4e40b7b]) successfully deleted
I20260809 18:56:39.140585 27956 tablet_bootstrap.cc:654] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:39.140655 27948 tablet_bootstrap.cc:492] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7: No bootstrap required, opened a new log
I20260809 18:56:39.140704 27948 ts_tablet_manager.cc:1397] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 18:56:39.140857 27948 raft_consensus.cc:348] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.140964 27948 raft_consensus.cc:374] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:39.140996 27948 raft_consensus.cc:729] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef4362bd41c472f85fabcd4f25dceb7, State: Initialized, Role: FOLLOWER
I20260809 18:56:39.141055 27948 consensus_queue.cc:260] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.141175 27948 ts_tablet_manager.cc:1428] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:39.141206 27956 tablet_bootstrap.cc:492] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: No bootstrap required, opened a new log
I20260809 18:56:39.141254 27956 ts_tablet_manager.cc:1397] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:39.141381 27956 raft_consensus.cc:348] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.141463 27956 raft_consensus.cc:374] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:39.141489 27956 raft_consensus.cc:729] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Initialized, Role: FOLLOWER
I20260809 18:56:39.141541 27956 consensus_queue.cc:260] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.141634 27956 ts_tablet_manager.cc:1428] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:39.308225 27919 raft_consensus.cc:482] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:39.308395 27919 raft_consensus.cc:504] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.308682 27919 leader_election.cc:288] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789)
I20260809 18:56:39.309010 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd491abe9824a4e9d1e9cae07af9c86" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7" is_pre_election: true
I20260809 18:56:39.309056 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd491abe9824a4e9d1e9cae07af9c86" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5" is_pre_election: true
I20260809 18:56:39.309165 27230 raft_consensus.cc:2454] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:39.309209 27459 raft_consensus.cc:2454] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 0.
I20260809 18:56:39.309490 27586 leader_election.cc:302] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, eef4362bd41c472f85fabcd4f25dceb7; no voters:
I20260809 18:56:39.309597 27919 raft_consensus.cc:2781] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:39.309648 27919 raft_consensus.cc:482] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:39.309669 27919 raft_consensus.cc:3037] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:39.310421 27919 raft_consensus.cc:504] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.310585 27919 leader_election.cc:288] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Requested vote from peers eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853), 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789)
I20260809 18:56:39.310745 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd491abe9824a4e9d1e9cae07af9c86" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef4362bd41c472f85fabcd4f25dceb7"
I20260809 18:56:39.310743 27459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd491abe9824a4e9d1e9cae07af9c86" candidate_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32781598729e42c4a7229fc45fa0e1a5"
I20260809 18:56:39.310858 27459 raft_consensus.cc:3037] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:39.310851 27230 raft_consensus.cc:3037] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:39.311677 27230 raft_consensus.cc:2454] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:39.311677 27459 raft_consensus.cc:2454] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0394fee9cad54c0a925eacdc3f52f6ba in term 1.
I20260809 18:56:39.311852 27584 leader_election.cc:302] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0394fee9cad54c0a925eacdc3f52f6ba, 32781598729e42c4a7229fc45fa0e1a5; no voters:
I20260809 18:56:39.311977 27919 raft_consensus.cc:2781] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:39.312068 27919 raft_consensus.cc:686] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Becoming Leader. State: Replica: 0394fee9cad54c0a925eacdc3f52f6ba, State: Running, Role: LEADER
I20260809 18:56:39.312126 27919 consensus_queue.cc:237] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } }
I20260809 18:56:39.312795 27000 catalog_manager.cc:5495] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3). New cstate: current_term: 1 leader_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0394fee9cad54c0a925eacdc3f52f6ba" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33337 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:39.324647 27230 raft_consensus.cc:1261] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:39.324705 27459 raft_consensus.cc:1261] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Refusing update from remote peer 0394fee9cad54c0a925eacdc3f52f6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:39.324920 27919 consensus_queue.cc:1035] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef4362bd41c472f85fabcd4f25dceb7" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:39.325029 27924 consensus_queue.cc:1035] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "32781598729e42c4a7229fc45fa0e1a5" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:56:39.329521 27905 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 18:56:40.847335 26999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:40.847476 26999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:40.848491 26999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 709d5b3519734a7a9fd91919977fd7f8: Sending DeleteTablet for 3 replicas of tablet 7bd491abe9824a4e9d1e9cae07af9c86
I20260809 18:56:40.848893 27667 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd491abe9824a4e9d1e9cae07af9c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:40 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:58538
I20260809 18:56:40.848883 27430 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd491abe9824a4e9d1e9cae07af9c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:40 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:52102
I20260809 18:56:40.848904 27203 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd491abe9824a4e9d1e9cae07af9c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:40 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:36216
I20260809 18:56:40.849053 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 27100
I20260809 18:56:40.857033 28025 tablet_replica.cc:330] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: stopping tablet replica
I20260809 18:56:40.857129 28025 raft_consensus.cc:2229] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:40.857177 28025 raft_consensus.cc:2258] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:40.849108 28023 tablet_replica.cc:330] T 7bd491abe9824a4e9d1e9cae07af9c86 P eef4362bd41c472f85fabcd4f25dceb7: stopping tablet replica
I20260809 18:56:40.858374 28025 ts_tablet_manager.cc:1905] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:40.860031 28022 tablet_replica.cc:330] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: stopping tablet replica
I20260809 18:56:40.860132 28022 raft_consensus.cc:2229] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:40.860242 28022 raft_consensus.cc:2258] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:40.860363 28025 ts_tablet_manager.cc:1918] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:40.860445 28025 log.cc:1196] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/7bd491abe9824a4e9d1e9cae07af9c86
I20260809 18:56:40.860589 28022 ts_tablet_manager.cc:1905] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:40.860704 28025 ts_tablet_manager.cc:1939] T 7bd491abe9824a4e9d1e9cae07af9c86 P 32781598729e42c4a7229fc45fa0e1a5: Deleting consensus metadata
I20260809 18:56:40.861159 26977 catalog_manager.cc:4841] TS 32781598729e42c4a7229fc45fa0e1a5 (127.23.229.2:44789): tablet 7bd491abe9824a4e9d1e9cae07af9c86 (table test-table [id=7ba62eb8767e496ea0af5e7acfa43371]) successfully deleted
I20260809 18:56:40.861882 28022 ts_tablet_manager.cc:1918] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:40.861967 28022 log.cc:1196] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/7bd491abe9824a4e9d1e9cae07af9c86
I20260809 18:56:40.862202 28022 ts_tablet_manager.cc:1939] T 7bd491abe9824a4e9d1e9cae07af9c86 P 0394fee9cad54c0a925eacdc3f52f6ba: Deleting consensus metadata
I20260809 18:56:40.862565 26979 catalog_manager.cc:4841] TS 0394fee9cad54c0a925eacdc3f52f6ba (127.23.229.3:33337): tablet 7bd491abe9824a4e9d1e9cae07af9c86 (table test-table [id=7ba62eb8767e496ea0af5e7acfa43371]) successfully deleted
W20260809 18:56:40.866348 26978 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:38853 (error 108)
I20260809 18:56:40.867030 28027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:40.866813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:38853 (local address 127.0.0.1:36228)
0809 18:56:40.866943 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:40.866988 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:38853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
I20260809 18:56:40.867130 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 27316
W20260809 18:56:40.867189 26978 catalog_manager.cc:4584] TS eef4362bd41c472f85fabcd4f25dceb7 (127.23.229.1:38853): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7bd491abe9824a4e9d1e9cae07af9c86: Network error: Client connection negotiation failed: client connection to 127.23.229.1:38853: connect: Connection refused (error 111)
I20260809 18:56:40.877643 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 27553
I20260809 18:56:40.891839 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26950
2026-08-09T18:56:40Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6051 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:40 dist-test-slave-jq4t krb5kdc[28030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:40 dist-test-slave-jq4t krb5kdc[28030](info): set up 2 sockets
Aug 09 18:56:40 dist-test-slave-jq4t krb5kdc[28030](info): commencing operation
krb5kdc: starting...
W20260809 18:56:42.171737 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:42.297906 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:39399
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:39399
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:42.386969 28049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:42.387228 28049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:42.387269 28049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:42.388468 28049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:42.388592 28049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:42.388618 28049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:42.388641 28049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:42.388669 28049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:42.390219 28049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:39399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:39399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:42.390537 28049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:42.390786 28049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:42.396407 28059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:42.396425 28064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:42.396420 28060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:42.396461 28049 server_base.cc:1034] running on GCE node
I20260809 18:56:42.396950 28049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:42.397251 28049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:42.398398 28049 hybrid_clock.cc:648] HybridClock initialized: now 1786301802398374 us; error 38 us; skew 500 ppm
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:42.401046 28049 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:42.401515 28049 webserver.cc:460] Webserver started at http://127.23.229.62:44105/ using document root <none> and password file <none>
I20260809 18:56:42.401757 28049 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:42.401830 28049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:42.401993 28049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:42.403167 28049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "1a7460908e1242fcb526b0d1eb9702ab"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "53f79e7f61e4a85601408e10a76e84dd"
server_key_iv: "56f9f6afcd58485bcd14cfe1818c2942"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.403548 28049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "1a7460908e1242fcb526b0d1eb9702ab"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "53f79e7f61e4a85601408e10a76e84dd"
server_key_iv: "56f9f6afcd58485bcd14cfe1818c2942"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.405055 28049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:42.405879 28079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.406067 28049 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:42.406188 28049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "1a7460908e1242fcb526b0d1eb9702ab"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "53f79e7f61e4a85601408e10a76e84dd"
server_key_iv: "56f9f6afcd58485bcd14cfe1818c2942"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.406266 28049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:42.424685 28049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:42.426882 28049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:42.427059 28049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:42.431490 28049 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:39399
I20260809 18:56:42.431532 28159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:39399 every 8 connection(s)
I20260809 18:56:42.431955 28049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:42.433036 28160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:42.433362 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 28049
I20260809 18:56:42.433470 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:42.433660 24468 external_mini_cluster.cc:1428] Setting key 79ddb4554bce827c2b6aa43a8d44aef7
I20260809 18:56:42.436321 28160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab: Bootstrap starting.
I20260809 18:56:42.437139 28160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:42.437470 28160 log.cc:824] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:42.438360 28160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab: No bootstrap required, opened a new log
I20260809 18:56:42.440546 28160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7460908e1242fcb526b0d1eb9702ab" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39399 } }
I20260809 18:56:42.440747 28160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:42.440784 28160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7460908e1242fcb526b0d1eb9702ab, State: Initialized, Role: FOLLOWER
I20260809 18:56:42.440932 28160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7460908e1242fcb526b0d1eb9702ab" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39399 } }
I20260809 18:56:42.441026 28160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:42.441059 28160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:42.441107 28160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 0 FOLLOWER]: Advancing to term 1
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:42.441886 28160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7460908e1242fcb526b0d1eb9702ab" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39399 } }
I20260809 18:56:42.441987 28160 leader_election.cc:302] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a7460908e1242fcb526b0d1eb9702ab; no voters:
I20260809 18:56:42.442179 28160 leader_election.cc:288] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:42.442245 28165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:42.442493 28160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:42.442835 28165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [term 1 LEADER]: Becoming Leader. State: Replica: 1a7460908e1242fcb526b0d1eb9702ab, State: Running, Role: LEADER
I20260809 18:56:42.442963 28165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7460908e1242fcb526b0d1eb9702ab" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39399 } }
I20260809 18:56:42.444140 28172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a7460908e1242fcb526b0d1eb9702ab. Latest consensus state: current_term: 1 leader_uuid: "1a7460908e1242fcb526b0d1eb9702ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7460908e1242fcb526b0d1eb9702ab" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39399 } } }
I20260809 18:56:42.444226 28172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:42.444331 28169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a7460908e1242fcb526b0d1eb9702ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7460908e1242fcb526b0d1eb9702ab" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39399 } } }
W20260809 18:56:42.444617 28189 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 18:56:42.444615 28169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab [sys.catalog]: This master's current role is: LEADER
W20260809 18:56:42.444701 28189 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:42.444769 28190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:42.444967 28190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:42.445901 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.434258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41730 (local address 127.23.229.62:39399)
0809 18:56:42.434486 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:42.434496 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:42.434539 (+ 43us) server_negotiation.cc:407] Connection header received
0809 18:56:42.435108 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:42.435118 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:42.435182 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:42.435340 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:42.436024 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.437451 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.438261 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.438890 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.439008 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.441808 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:42.441812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:42.441812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:42.441823 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:42.444096 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.444565 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.444569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.444570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.444688 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.444941 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.444942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.444943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.445272 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:42.445431 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:42.445568 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 18:56:42.445710 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":92,"threads_started":1}
I20260809 18:56:42.446720 28190 catalog_manager.cc:1347] Generated new cluster ID: b67f24d674b84afd84e8b6c6ba7f7ef5
I20260809 18:56:42.446779 28190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:42.476768 28190 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:42.477551 28190 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:42.485167 28190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a7460908e1242fcb526b0d1eb9702ab: Generated new TSK 0
I20260809 18:56:42.485391 28190 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:42.523468 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39399
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:42.610848 28199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:42.611065 28199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:42.611092 28199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:42.612208 28199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:42.612244 28199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:42.612270 28199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:42.613704 28199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:42.613900 28199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:42.614085 28199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:42.619223 28211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:42.619235 28207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:42.619235 28206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:42.619252 28199 server_base.cc:1034] running on GCE node
I20260809 18:56:42.619647 28199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:42.619875 28199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:42.621021 28199 hybrid_clock.cc:648] HybridClock initialized: now 1786301802621005 us; error 33 us; skew 500 ppm
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:42.623759 28199 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:42.624163 28199 webserver.cc:460] Webserver started at http://127.23.229.1:42549/ using document root <none> and password file <none>
I20260809 18:56:42.624385 28199 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:42.624428 28199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:42.624584 28199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:42.625624 28199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "57e14a5cadf94955b83a8c88b4bf8438"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "d3e0110b2590fe7b25c0d4cc4a83b80f"
server_key_iv: "3b6fe9d577aab2fbba27ccc5bbd0d666"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.625931 28199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "57e14a5cadf94955b83a8c88b4bf8438"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "d3e0110b2590fe7b25c0d4cc4a83b80f"
server_key_iv: "3b6fe9d577aab2fbba27ccc5bbd0d666"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.627233 28199 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:56:42.627964 28222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.628176 28199 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:42.628276 28199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "57e14a5cadf94955b83a8c88b4bf8438"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "d3e0110b2590fe7b25c0d4cc4a83b80f"
server_key_iv: "3b6fe9d577aab2fbba27ccc5bbd0d666"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.628357 28199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:42.645686 28199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:42.647711 28199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:42.647836 28199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:42.648030 28199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:42.648394 28199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:42.648430 28199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.648453 28199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:42.648535 28199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.654515 28199 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:46881
I20260809 18:56:42.654598 28400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:46881 every 8 connection(s)
I20260809 18:56:42.654942 28199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:42.659595 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 28199
I20260809 18:56:42.659703 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:42.659943 24468 external_mini_cluster.cc:1428] Setting key f9ca3b210fbad4510feafee660a99225
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:42.665357 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.655775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:43523 (local address 127.23.229.62:39399)
0809 18:56:42.655863 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:42.655866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:42.656041 (+ 175us) server_negotiation.cc:407] Connection header received
0809 18:56:42.656597 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:42.656599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:42.656611 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:42.656664 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:42.657687 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.658241 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.659279 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.659514 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.659578 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.662250 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:42.662251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:42.662252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:42.662260 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:42.663744 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.664212 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.664214 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.664214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.664281 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.664592 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.664593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.664593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.664720 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:42.664802 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:42.665168 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 18:56:42.665261 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 18:56:42.665570 28406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.655719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:39399 (local address 127.23.229.1:43523)
0809 18:56:42.655912 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:42.655953 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:42.656440 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:42.656723 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:42.656727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:42.657349 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:42.657565 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:42.657570 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.658341 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.658342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:42.659188 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:42.659190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.659629 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.659630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:42.659811 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.660517 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:42.660528 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:42.662141 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:42.663858 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:42.663866 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:42.663869 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:42.664127 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:42.664356 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:42.664357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:42.664357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:42.664528 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:42.664793 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:42.664801 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:42.664996 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 18:56:42.665128 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 18:56:42.665307 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":116,"threads_started":1}
I20260809 18:56:42.666110 28401 heartbeater.cc:347] Connected to a master server at 127.23.229.62:39399
I20260809 18:56:42.666214 28401 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:42.666432 28401 heartbeater.cc:511] Master 127.23.229.62:39399 requested a full tablet report, sending...
I20260809 18:56:42.666986 28104 ts_manager.cc:194] Registered new tserver with Master: 57e14a5cadf94955b83a8c88b4bf8438 (127.23.229.1:46881)
I20260809 18:56:42.667629 28104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:43523
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:42.687961 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39399
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:42.772837 28411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:42.773128 28411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:42.773171 28411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:42.774366 28411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:42.774443 28411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:42.774492 28411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:42.776006 28411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:42.776283 28411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:42.776599 28411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:42.781975 28422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:42.782004 28425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:42.782032 28428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:42.782119 28411 server_base.cc:1034] running on GCE node
I20260809 18:56:42.782378 28411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:42.782634 28411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:42.783774 28411 hybrid_clock.cc:648] HybridClock initialized: now 1786301802783763 us; error 29 us; skew 500 ppm
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:42.786487 28411 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:42.786953 28411 webserver.cc:460] Webserver started at http://127.23.229.2:44901/ using document root <none> and password file <none>
I20260809 18:56:42.787197 28411 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:42.787268 28411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:42.787436 28411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:42.788626 28411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "80673e8fe44848418c4435b385455369"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "4fd2c29edb2c03e9fef34dbc58cade41"
server_key_iv: "ebc5e929e2ef3bcbe3a8df9008a882de"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.789166 28411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "80673e8fe44848418c4435b385455369"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "4fd2c29edb2c03e9fef34dbc58cade41"
server_key_iv: "ebc5e929e2ef3bcbe3a8df9008a882de"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.790647 28411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:56:42.791411 28436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.791585 28411 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:42.791698 28411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "80673e8fe44848418c4435b385455369"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "4fd2c29edb2c03e9fef34dbc58cade41"
server_key_iv: "ebc5e929e2ef3bcbe3a8df9008a882de"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.791778 28411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:42.805783 28411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:42.808283 28411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:42.808569 28411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:42.808862 28411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:42.809217 28411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:42.809278 28411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.809322 28411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:42.809346 28411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.815260 28411 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:42469
I20260809 18:56:42.815342 28604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:42469 every 8 connection(s)
I20260809 18:56:42.815703 28411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:42.823676 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 28411
I20260809 18:56:42.823792 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:42.824028 24468 external_mini_cluster.cc:1428] Setting key 65f8e8b4f10629c3d4d9679672e0f46b
I20260809 18:56:42.825402 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.816549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:46737 (local address 127.23.229.62:39399)
0809 18:56:42.816597 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:42.816599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:42.816800 (+ 201us) server_negotiation.cc:407] Connection header received
0809 18:56:42.817372 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:42.817373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:42.817388 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:42.817437 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:42.818418 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.818939 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.819965 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.820170 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.820261 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.822411 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:42.822413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:42.822413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:42.822420 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:42.823661 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.824204 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.824205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.824205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.824281 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.824665 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.824666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.824666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.824794 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:42.824932 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:42.825222 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 18:56:42.825312 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:56:42.825593 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.816482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:39399 (local address 127.23.229.2:46737)
0809 18:56:42.816669 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:42.816714 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:42.817245 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:42.817510 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:42.817514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:42.818106 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:42.818308 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:42.818312 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.819050 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.819051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:42.819867 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:42.819870 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.820272 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.820274 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:42.820421 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.820964 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:42.820972 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:42.822324 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:42.823752 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:42.823760 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:42.823762 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:42.824076 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:42.824419 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:42.824420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:42.824421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:42.824595 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:42.824921 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:42.824929 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:42.825079 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 18:56:42.825185 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:56:42.825349 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260809 18:56:42.826077 28605 heartbeater.cc:347] Connected to a master server at 127.23.229.62:39399
I20260809 18:56:42.826164 28605 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:42.826371 28605 heartbeater.cc:511] Master 127.23.229.62:39399 requested a full tablet report, sending...
I20260809 18:56:42.826754 28104 ts_manager.cc:194] Registered new tserver with Master: 80673e8fe44848418c4435b385455369 (127.23.229.2:42469)
I20260809 18:56:42.827142 28104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:46737
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:42.851477 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39399
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:42.938468 28615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:42.938727 28615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:42.938769 28615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:42.939996 28615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:42.940073 28615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:42.940114 28615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:42.941745 28615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:42.942205 28615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:42.942487 28615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:42.948124 28626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:42.948359 28615 server_base.cc:1034] running on GCE node
W20260809 18:56:42.948108 28623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:42.948108 28624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:42.948711 28615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:42.948987 28615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:42.950145 28615 hybrid_clock.cc:648] HybridClock initialized: now 1786301802950119 us; error 47 us; skew 500 ppm
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:42.952780 28615 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:42.953275 28615 webserver.cc:460] Webserver started at http://127.23.229.3:39807/ using document root <none> and password file <none>
I20260809 18:56:42.953533 28615 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:42.953580 28615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:42.953754 28615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:42.954843 28615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "c1155d8206054ed8a759ee957e163998"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "ab285126409ae38d64e37d00bfbe0acc"
server_key_iv: "d376bf12718ad93fbd55027f2ec4bd45"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.955228 28615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "c1155d8206054ed8a759ee957e163998"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "ab285126409ae38d64e37d00bfbe0acc"
server_key_iv: "d376bf12718ad93fbd55027f2ec4bd45"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.956677 28615 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260809 18:56:42.957473 28638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.957652 28615 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:42.957767 28615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "c1155d8206054ed8a759ee957e163998"
format_stamp: "Formatted at 2026-08-09 18:56:42 on dist-test-slave-jq4t"
server_key: "ab285126409ae38d64e37d00bfbe0acc"
server_key_iv: "d376bf12718ad93fbd55027f2ec4bd45"
server_key_version: "encryptionkey@0"
I20260809 18:56:42.957846 28615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:42.968411 28615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:42.970465 28615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:42.970661 28615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:42.970940 28615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:42.971302 28615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:42.971361 28615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.971408 28615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:42.971438 28615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:42.977656 28615 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:39655
I20260809 18:56:42.977705 28817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:39655 every 8 connection(s)
I20260809 18:56:42.978065 28615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:56:42 dist-test-slave-jq4t krb5kdc[28030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:42.987552 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 28615
I20260809 18:56:42.987672 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:42.987880 24468 external_mini_cluster.cc:1428] Setting key 81027b0c6ab0c9a74ec9572a959420e6
I20260809 18:56:42.988082 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.978902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:49977 (local address 127.23.229.62:39399)
0809 18:56:42.978999 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:42.979001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:42.979122 (+ 121us) server_negotiation.cc:407] Connection header received
0809 18:56:42.979616 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:42.979617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:42.979630 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:42.979685 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:42.980779 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.981300 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.982355 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.982541 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.982594 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.985052 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:42.985054 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:42.985054 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:42.985061 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:42.986451 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.986879 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.986880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.986881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.986937 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.987176 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.987177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.987177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.987352 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:42.987407 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:42.987833 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 18:56:42.987914 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:56:42.988313 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.978817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:39399 (local address 127.23.229.3:49977)
0809 18:56:42.978973 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:42.979025 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:42.979525 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:42.979748 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:42.979751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:42.980377 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:42.980687 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:42.980693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.981414 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.981415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:42.982270 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:42.982272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.982621 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.982622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:42.982733 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.983377 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:42.983386 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:42.984949 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:42.986538 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:42.986546 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:42.986549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:42.986785 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:42.986999 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:42.987000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:42.987000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:42.987120 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:42.987421 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:42.987429 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:42.987618 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 18:56:42.987799 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 18:56:42.988038 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260809 18:56:42.988865 28818 heartbeater.cc:347] Connected to a master server at 127.23.229.62:39399
I20260809 18:56:42.989001 28818 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:42.989205 28818 heartbeater.cc:511] Master 127.23.229.62:39399 requested a full tablet report, sending...
I20260809 18:56:42.989619 28104 ts_manager.cc:194] Registered new tserver with Master: c1155d8206054ed8a759ee957e163998 (127.23.229.3:39655)
I20260809 18:56:42.990025 28104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:49977
I20260809 18:56:43.000128 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:56:43.013763 28163 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:43.012764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41732 (local address 127.23.229.62:39399)
0809 18:56:43.012830 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:43.012832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:43.012934 (+ 102us) server_negotiation.cc:407] Connection header received
0809 18:56:43.012987 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:43.012988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:43.012998 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:43.013066 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:43.013665 (+ 599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41732: BlockingRecv error: recv got EOF from 127.0.0.1:41732 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:56:43.014823 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 28199
I20260809 18:56:43.035820 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 28411
I20260809 18:56:43.047456 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 28615
I20260809 18:56:43.058322 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 28049
2026-08-09T18:56:43Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2160 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:43 dist-test-slave-jq4t krb5kdc[28843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:43 dist-test-slave-jq4t krb5kdc[28843](info): set up 2 sockets
Aug 09 18:56:43 dist-test-slave-jq4t krb5kdc[28843](info): commencing operation
krb5kdc: starting...
W20260809 18:56:44.317755 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:44 dist-test-slave-jq4t krb5kdc[28843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:44.445492 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38079
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:40103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:38079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:44.531096 28864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:44.531324 28864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:44.531350 28864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:44.532624 28864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:44.532668 28864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:44.532683 28864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:44.532696 28864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:44.532728 28864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:44.534312 28864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:40103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:38079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:44.534595 28864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:44.534868 28864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:44.540228 28873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:44.540315 28864 server_base.cc:1034] running on GCE node
W20260809 18:56:44.540206 28871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:44.540207 28876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:44.540737 28864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:44.541064 28864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:44.542270 28864 hybrid_clock.cc:648] HybridClock initialized: now 1786301804542252 us; error 48 us; skew 500 ppm
Aug 09 18:56:44 dist-test-slave-jq4t krb5kdc[28843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301804, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:44.548025 28864 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:44.548578 28864 webserver.cc:460] Webserver started at http://127.23.229.62:46613/ using document root <none> and password file <none>
I20260809 18:56:44.548784 28864 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:44.548825 28864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:44.548930 28864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:44.550037 28864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "8a1314c546424754b7173f78148e20b6"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-jq4t"
server_key: "6f759b0fdc86ec1324ef51c031bd9e0f"
server_key_iv: "bdb04093a726641e1fa6757be624808f"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.550374 28864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "8a1314c546424754b7173f78148e20b6"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-jq4t"
server_key: "6f759b0fdc86ec1324ef51c031bd9e0f"
server_key_iv: "bdb04093a726641e1fa6757be624808f"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.551908 28864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:44.552807 28886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:44.553004 28864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:44.553110 28864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "8a1314c546424754b7173f78148e20b6"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-jq4t"
server_key: "6f759b0fdc86ec1324ef51c031bd9e0f"
server_key_iv: "bdb04093a726641e1fa6757be624808f"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.553176 28864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:44.585340 28864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:44.587586 28864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:44.587710 28864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:44.592024 28864 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:38079
I20260809 18:56:44.592089 28965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:38079 every 8 connection(s)
I20260809 18:56:44.592748 28864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:44.593516 28967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:44.595969 28967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6: Bootstrap starting.
I20260809 18:56:44.596765 28967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:44.597170 28967 log.cc:824] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:44.597903 28967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6: No bootstrap required, opened a new log
I20260809 18:56:44.599546 28967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a1314c546424754b7173f78148e20b6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38079 } }
I20260809 18:56:44.599715 28967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:44.599764 28967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a1314c546424754b7173f78148e20b6, State: Initialized, Role: FOLLOWER
I20260809 18:56:44.599961 28967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a1314c546424754b7173f78148e20b6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38079 } }
I20260809 18:56:44.600080 28967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:44.600131 28967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:44.600183 28967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:44.601176 28967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a1314c546424754b7173f78148e20b6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38079 } }
I20260809 18:56:44.601308 28967 leader_election.cc:302] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a1314c546424754b7173f78148e20b6; no voters:
I20260809 18:56:44.601486 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 28864
I20260809 18:56:44.601531 28967 leader_election.cc:288] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:44.601565 28970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:44.601596 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:44.601729 28970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [term 1 LEADER]: Becoming Leader. State: Replica: 8a1314c546424754b7173f78148e20b6, State: Running, Role: LEADER
I20260809 18:56:44.601786 24468 external_mini_cluster.cc:1428] Setting key 455fb125f6acc6390ec57bea1b97b425
I20260809 18:56:44.601810 28967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:44.601823 28970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a1314c546424754b7173f78148e20b6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38079 } }
I20260809 18:56:44.602221 28970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a1314c546424754b7173f78148e20b6. Latest consensus state: current_term: 1 leader_uuid: "8a1314c546424754b7173f78148e20b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a1314c546424754b7173f78148e20b6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38079 } } }
I20260809 18:56:44.602288 28970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:44.602425 28972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a1314c546424754b7173f78148e20b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a1314c546424754b7173f78148e20b6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38079 } } }
I20260809 18:56:44.602501 28972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6 [sys.catalog]: This master's current role is: LEADER
W20260809 18:56:44.604316 28996 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:56:44.604383 28996 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:44.604447 28976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:44.604633 28976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:44.606091 28976 catalog_manager.cc:1347] Generated new cluster ID: 070e38f2f7e54398baf02a6b4bc92962
I20260809 18:56:44.606146 28976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:56:44 dist-test-slave-jq4t krb5kdc[28843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:44.615382 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:44.602560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58984 (local address 127.23.229.62:38079)
0809 18:56:44.602756 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:44.602766 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:44.603138 (+ 372us) server_negotiation.cc:407] Connection header received
0809 18:56:44.603354 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:44.603363 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:44.603447 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:44.603634 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:44.604573 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.606019 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.607148 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.607773 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.607876 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:44.610951 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:44.610958 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:44.610958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:44.610976 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:44.613197 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:44.613882 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:44.613886 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:44.613886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:44.614018 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:44.614313 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:44.614314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:44.614314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:44.614696 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:44.614875 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:44.614956 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:56:44.615121 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":87,"threads_started":1}
I20260809 18:56:44.616346 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:44.620286 28976 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:44.621100 28976 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:44.624969 28976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a1314c546424754b7173f78148e20b6: Generated new TSK 0
I20260809 18:56:44.625166 28976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:44.634306 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:44.630234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59000 (local address 127.23.229.62:38079)
0809 18:56:44.630314 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:44.630317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:44.630411 (+ 94us) server_negotiation.cc:407] Connection header received
0809 18:56:44.630496 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:44.630497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:44.630511 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:44.630574 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:44.630958 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.631785 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.632596 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.632952 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.633036 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:44.633759 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:44.633760 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:44.633760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:44.634014 (+ 254us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:44.634037 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:44.634045 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:44.634110 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:44.634189 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 18:56:44.634220 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:56:44.636897 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 28864
2026-08-09T18:56:44Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1588 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:44 dist-test-slave-jq4t krb5kdc[29016](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:44 dist-test-slave-jq4t krb5kdc[29016](info): set up 2 sockets
Aug 09 18:56:44 dist-test-slave-jq4t krb5kdc[29016](info): commencing operation
krb5kdc: starting...
W20260809 18:56:45.913651 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:45 dist-test-slave-jq4t krb5kdc[29016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:46.040967 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43615
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:46.126102 29035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:46.126327 29035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:46.126348 29035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:46.127473 29035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:46.127512 29035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:46.127526 29035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:46.127539 29035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:46.127552 29035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:46.129071 29035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:46.129277 29035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:46.129462 29035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:46.134615 29042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.134608 29040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.134601 29046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:46.134866 29035 server_base.cc:1034] running on GCE node
I20260809 18:56:46.135200 29035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:46.135507 29035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:46.136674 29035 hybrid_clock.cc:648] HybridClock initialized: now 1786301806136669 us; error 41 us; skew 500 ppm
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:46.148744 29035 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:46.149288 29035 webserver.cc:460] Webserver started at http://127.23.229.62:37955/ using document root <none> and password file <none>
I20260809 18:56:46.149528 29035 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:46.149597 29035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:46.149755 29035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:46.150888 29035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "27137c885678492d8a85505ab7bcd9f1"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "bd9d01be1e3517ee64baebe52d9f7cea"
server_key_iv: "f9b5ef64d72f4db459b9e062572ed672"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.151279 29035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "27137c885678492d8a85505ab7bcd9f1"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "bd9d01be1e3517ee64baebe52d9f7cea"
server_key_iv: "f9b5ef64d72f4db459b9e062572ed672"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.152737 29035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 18:56:46.153513 29056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.153688 29035 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:46.153800 29035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "27137c885678492d8a85505ab7bcd9f1"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "bd9d01be1e3517ee64baebe52d9f7cea"
server_key_iv: "f9b5ef64d72f4db459b9e062572ed672"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.153875 29035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:46.163403 29035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:46.165815 29035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:46.166000 29035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:46.170372 29035 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43615
I20260809 18:56:46.170411 29131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43615 every 8 connection(s)
I20260809 18:56:46.170779 29035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:46.171963 29133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:46.174396 29133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1: Bootstrap starting.
I20260809 18:56:46.174970 29133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:46.175215 29133 log.cc:824] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:46.175894 29133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1: No bootstrap required, opened a new log
I20260809 18:56:46.176947 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 29035
I20260809 18:56:46.177068 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:46.177248 24468 external_mini_cluster.cc:1428] Setting key 97b72b94341f3dc44e90c1cf07b556c0
I20260809 18:56:46.178177 29133 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27137c885678492d8a85505ab7bcd9f1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43615 } }
I20260809 18:56:46.178351 29133 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:46.178391 29133 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27137c885678492d8a85505ab7bcd9f1, State: Initialized, Role: FOLLOWER
I20260809 18:56:46.178571 29133 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27137c885678492d8a85505ab7bcd9f1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43615 } }
I20260809 18:56:46.178673 29133 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:46.178710 29133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:46.178764 29133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:46.179773 29133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27137c885678492d8a85505ab7bcd9f1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43615 } }
I20260809 18:56:46.179872 29133 leader_election.cc:302] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27137c885678492d8a85505ab7bcd9f1; no voters:
I20260809 18:56:46.180084 29133 leader_election.cc:288] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:46.180137 29139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:46.180282 29139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [term 1 LEADER]: Becoming Leader. State: Replica: 27137c885678492d8a85505ab7bcd9f1, State: Running, Role: LEADER
I20260809 18:56:46.180356 29133 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:46.180429 29139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27137c885678492d8a85505ab7bcd9f1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43615 } }
I20260809 18:56:46.180919 29141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27137c885678492d8a85505ab7bcd9f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27137c885678492d8a85505ab7bcd9f1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43615 } } }
I20260809 18:56:46.180998 29141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:46.180962 29142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27137c885678492d8a85505ab7bcd9f1. Latest consensus state: current_term: 1 leader_uuid: "27137c885678492d8a85505ab7bcd9f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27137c885678492d8a85505ab7bcd9f1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43615 } } }
I20260809 18:56:46.181066 29142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1 [sys.catalog]: This master's current role is: LEADER
W20260809 18:56:46.182523 29165 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:56:46.182581 29165 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:46.182669 29153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:46.182888 29153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:46.184646 29153 catalog_manager.cc:1347] Generated new cluster ID: 6f70bf6412054121b5bd3313970b76f6
I20260809 18:56:46.184686 29153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:46.189050 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.177831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53720 (local address 127.23.229.62:43615)
0809 18:56:46.178036 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.178044 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.178071 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:56:46.178173 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.178179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.178221 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.178333 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.179227 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.180396 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.181552 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.182283 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.182394 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.185191 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.185195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.185196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:46.185208 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.187132 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.187528 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.187531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.187531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.187663 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.187853 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.187853 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.187854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.188130 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.188642 (+ 512us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.188716 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.188846 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260809 18:56:46.220446 29153 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:46.221302 29153 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:46.227643 29153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27137c885678492d8a85505ab7bcd9f1: Generated new TSK 0
I20260809 18:56:46.227871 29153 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:46.266655 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43615
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:46.354354 29170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:46.354578 29170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:46.354602 29170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:46.355800 29170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:46.355846 29170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:46.355873 29170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:46.357497 29170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:46.357781 29170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:46.358042 29170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:46.363256 29182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.363234 29183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:46.363304 29170 server_base.cc:1034] running on GCE node
W20260809 18:56:46.363245 29187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:46.363670 29170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:46.363943 29170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:46.365108 29170 hybrid_clock.cc:648] HybridClock initialized: now 1786301806365091 us; error 44 us; skew 500 ppm
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:46.367674 29170 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:46.368135 29170 webserver.cc:460] Webserver started at http://127.23.229.1:37185/ using document root <none> and password file <none>
I20260809 18:56:46.368335 29170 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:46.368374 29170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:46.368465 29170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:46.369560 29170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "3f80d6edd99442ff9cc250fe7916819d"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "f31da1fc98007599968a20b69eb603a5"
server_key_iv: "1cf89d61b19b749be0a8e067be870f4f"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.369866 29170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "3f80d6edd99442ff9cc250fe7916819d"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "f31da1fc98007599968a20b69eb603a5"
server_key_iv: "1cf89d61b19b749be0a8e067be870f4f"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.371183 29170 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:56:46.371922 29197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.372120 29170 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:46.372241 29170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "3f80d6edd99442ff9cc250fe7916819d"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "f31da1fc98007599968a20b69eb603a5"
server_key_iv: "1cf89d61b19b749be0a8e067be870f4f"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.372319 29170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:46.401176 29170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:46.403430 29170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:46.403610 29170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:46.403887 29170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:46.404271 29170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:46.404315 29170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.404340 29170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:46.404351 29170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.410616 29170 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:42541
I20260809 18:56:46.410673 29349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:42541 every 8 connection(s)
I20260809 18:56:46.411077 29170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:46.412752 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 29170
I20260809 18:56:46.412922 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:46.413126 24468 external_mini_cluster.cc:1428] Setting key d9378bd6b22a5fb3bca00a9cb49c298f
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:46.421806 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.411877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:56837 (local address 127.23.229.62:43615)
0809 18:56:46.411963 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.411965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.412190 (+ 225us) server_negotiation.cc:407] Connection header received
0809 18:56:46.412920 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.412922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.412936 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.412986 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.414307 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.414831 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.415898 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.416127 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.416212 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.418589 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.418591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.418591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:46.418602 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.420199 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.420745 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.420745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.420746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.420800 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.421132 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.421133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.421133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.421244 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.421293 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.421662 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.421738 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:56:46.422116 29353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.411828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43615 (local address 127.23.229.1:56837)
0809 18:56:46.412043 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:46.412089 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:46.412714 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:46.413116 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:46.413121 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:46.413977 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:46.414204 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:46.414209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.414940 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.414941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:46.415800 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:46.415802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.416223 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.416224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:46.416357 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.417040 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:46.417049 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:46.418479 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:46.420290 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:46.420299 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:46.420302 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:46.420668 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:46.420890 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:46.420891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:46.420891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:46.421057 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:46.421314 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:46.421321 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:46.421507 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 18:56:46.421628 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 18:56:46.421819 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":136,"threads_started":1}
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 18:56:46.422724 29350 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43615
I20260809 18:56:46.422840 29350 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:46.423054 29350 heartbeater.cc:511] Master 127.23.229.62:43615 requested a full tablet report, sending...
I20260809 18:56:46.423602 29081 ts_manager.cc:194] Registered new tserver with Master: 3f80d6edd99442ff9cc250fe7916819d (127.23.229.1:42541)
I20260809 18:56:46.424247 29081 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:56837
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:46.441395 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43615
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:46.528559 29356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:46.528789 29356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:46.528825 29356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:46.530054 29356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:46.530103 29356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:46.530131 29356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:46.531733 29356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:46.532037 29356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:46.532295 29356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:46.537781 29363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.537760 29366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.537760 29364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:46.538094 29356 server_base.cc:1034] running on GCE node
I20260809 18:56:46.538331 29356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:46.538589 29356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:46.539760 29356 hybrid_clock.cc:648] HybridClock initialized: now 1786301806539743 us; error 29 us; skew 500 ppm
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:46.542425 29356 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:46.542834 29356 webserver.cc:460] Webserver started at http://127.23.229.2:36233/ using document root <none> and password file <none>
I20260809 18:56:46.543107 29356 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:46.543155 29356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:46.543331 29356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:46.544414 29356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "b66ab353823a4a50867f00226bbb6ce8"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "896e6263c6f0c815cb53c4f610340864"
server_key_iv: "3329ffd9b83959aa5e7f91c3630bdd81"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.544840 29356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "b66ab353823a4a50867f00226bbb6ce8"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "896e6263c6f0c815cb53c4f610340864"
server_key_iv: "3329ffd9b83959aa5e7f91c3630bdd81"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.546182 29356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:46.546952 29379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.547132 29356 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:46.547251 29356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "b66ab353823a4a50867f00226bbb6ce8"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "896e6263c6f0c815cb53c4f610340864"
server_key_iv: "3329ffd9b83959aa5e7f91c3630bdd81"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.547333 29356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:46.563901 29356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:46.566193 29356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:46.566375 29356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:46.566634 29356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:46.566987 29356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:46.567045 29356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.567081 29356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:46.567128 29356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.573393 29356 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:35303
I20260809 18:56:46.573453 29557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:35303 every 8 connection(s)
I20260809 18:56:46.573782 29356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:46.577849 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 29356
I20260809 18:56:46.577979 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:46.578176 24468 external_mini_cluster.cc:1428] Setting key a3444849ecdae23fe179eedc3a1e224e
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:46.585047 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.574529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:50717 (local address 127.23.229.62:43615)
0809 18:56:46.574613 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.574616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.574806 (+ 190us) server_negotiation.cc:407] Connection header received
0809 18:56:46.575430 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.575431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.575445 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.575493 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.576632 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.577188 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.578598 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.578840 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.578909 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.581759 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.581760 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.581761 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:46.581768 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.583363 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.583935 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.583937 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.583937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.583994 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.584305 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.584306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.584306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.584433 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.584531 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.584894 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.584976 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:56:46.585388 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.574491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43615 (local address 127.23.229.2:50717)
0809 18:56:46.574683 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:46.574721 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:46.575307 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:46.575574 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:46.575577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:46.576255 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:46.576530 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:46.576543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.577295 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.577296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:46.578492 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:46.578495 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.578932 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.578933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:46.579094 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.579753 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:46.579765 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:46.581658 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:46.583480 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:46.583492 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:46.583495 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:46.583852 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:46.584067 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:46.584068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:46.584069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:46.584232 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:46.584526 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:46.584534 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:46.584733 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 18:56:46.584875 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 18:56:46.585082 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":90,"threads_started":1}
I20260809 18:56:46.585976 29558 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43615
I20260809 18:56:46.586097 29558 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:46.586311 29558 heartbeater.cc:511] Master 127.23.229.62:43615 requested a full tablet report, sending...
I20260809 18:56:46.586740 29081 ts_manager.cc:194] Registered new tserver with Master: b66ab353823a4a50867f00226bbb6ce8 (127.23.229.2:35303)
I20260809 18:56:46.587143 29081 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:50717
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:46.605543 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43615
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:46.690339 29564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:46.690590 29564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:46.690632 29564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:46.691826 29564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:46.691900 29564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:46.691942 29564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:46.693496 29564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:46.693779 29564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:46.694024 29564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:46.699390 29574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.699390 29573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:46.699720 29564 server_base.cc:1034] running on GCE node
W20260809 18:56:46.699888 29579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:46.700146 29564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:46.700435 29564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:46.701623 29564 hybrid_clock.cc:648] HybridClock initialized: now 1786301806701608 us; error 32 us; skew 500 ppm
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:46.704265 29564 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:46.704792 29564 webserver.cc:460] Webserver started at http://127.23.229.3:40535/ using document root <none> and password file <none>
I20260809 18:56:46.705067 29564 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:46.705139 29564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:46.705295 29564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:46.706393 29564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "9f2b56d4458d4594bd94d866413ea7b1"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "69335b287e77783ad36b8ecb453a125c"
server_key_iv: "7c85027a1dd956f04a38cdd434904d4b"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.706765 29564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "9f2b56d4458d4594bd94d866413ea7b1"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "69335b287e77783ad36b8ecb453a125c"
server_key_iv: "7c85027a1dd956f04a38cdd434904d4b"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.708148 29564 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:56:46.708995 29593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.709175 29564 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:56:46.709285 29564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "9f2b56d4458d4594bd94d866413ea7b1"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-jq4t"
server_key: "69335b287e77783ad36b8ecb453a125c"
server_key_iv: "7c85027a1dd956f04a38cdd434904d4b"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.709364 29564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:46.734658 29564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:46.736987 29564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:46.737115 29564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:46.737300 29564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:46.737598 29564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:46.737632 29564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.737655 29564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:46.737668 29564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.743609 29564 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:46211
I20260809 18:56:46.743695 29765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:46211 every 8 connection(s)
I20260809 18:56:46.744069 29564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:46.751400 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 29564
I20260809 18:56:46.751509 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:46.751715 24468 external_mini_cluster.cc:1428] Setting key 43197102545d5210f941a4e16f103876
I20260809 18:56:46.753955 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.745064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:57121 (local address 127.23.229.62:43615)
0809 18:56:46.745153 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.745156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.745270 (+ 114us) server_negotiation.cc:407] Connection header received
0809 18:56:46.745781 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.745782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.745793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.745852 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.746861 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.747386 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.748391 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.748667 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.748724 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.751130 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.751132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.751132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:46.751139 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.752693 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.753082 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.753083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.753084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.753146 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.753431 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.753431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.753432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.753561 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.753616 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.753820 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.753890 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 18:56:46.754230 29770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.744931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43615 (local address 127.23.229.3:57121)
0809 18:56:46.745138 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:46.745179 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:46.745688 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:46.745933 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:46.745937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:46.746568 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:46.746776 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:46.746781 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.747471 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.747472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:46.748308 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:46.748310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.748743 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.748744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:46.748858 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.749368 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:46.749377 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:46.750968 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:46.752756 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:46.752762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:46.752764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:46.752990 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:46.753240 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:46.753241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:46.753242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:46.753360 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:46.753604 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:46.753607 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:46.753727 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 18:56:46.753807 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:56:46.753941 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260809 18:56:46.754792 29767 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43615
I20260809 18:56:46.754901 29767 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:46.755095 29767 heartbeater.cc:511] Master 127.23.229.62:43615 requested a full tablet report, sending...
I20260809 18:56:46.755502 29081 ts_manager.cc:194] Registered new tserver with Master: 9f2b56d4458d4594bd94d866413ea7b1 (127.23.229.3:46211)
I20260809 18:56:46.755897 29081 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:57121
I20260809 18:56:46.763638 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301806, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:46.788206 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.780892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53732 (local address 127.23.229.62:43615)
0809 18:56:46.780963 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.780965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.781068 (+ 103us) server_negotiation.cc:407] Connection header received
0809 18:56:46.781134 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.781135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.781148 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.781218 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.781791 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.782370 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.783091 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.783279 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.783333 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.785686 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.785688 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.785688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:46.785696 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.786988 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.787337 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.787339 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.787339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.787414 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.787655 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.787656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.787656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.787835 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.787914 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.788024 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.788095 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 18:56:46.788571 29081 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53732
I20260809 18:56:46.789124 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 29170
I20260809 18:56:46.805979 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 29356
I20260809 18:56:46.814425 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 29564
I20260809 18:56:46.824844 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 29035
2026-08-09T18:56:46Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2182 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29786](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29786](info): set up 2 sockets
Aug 09 18:56:46 dist-test-slave-jq4t krb5kdc[29786](info): commencing operation
krb5kdc: starting...
W20260809 18:56:48.083671 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:48.208235 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:39251
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:39251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:48.294938 29807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:48.295208 29807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:48.295248 29807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:48.296442 29807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:48.296535 29807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:48.296564 29807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:48.296595 29807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:48.296618 29807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:48.298193 29807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:39251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:39251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:48.298491 29807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:48.298730 29807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:48.303894 29826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:48.303853 29822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.304065 29807 server_base.cc:1034] running on GCE node
W20260809 18:56:48.304149 29821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.304458 29807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:48.304808 29807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:48.305960 29807 hybrid_clock.cc:648] HybridClock initialized: now 1786301808305947 us; error 29 us; skew 500 ppm
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:48.308689 29807 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:48.309144 29807 webserver.cc:460] Webserver started at http://127.23.229.62:39657/ using document root <none> and password file <none>
I20260809 18:56:48.309378 29807 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:48.309424 29807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:48.309602 29807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:48.310693 29807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "d124018c15f144dab7b2f342db1056f7"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "0bc748f732b1060a6165a47442d5e0b9"
server_key_iv: "2d1f1d1cad43c6435e6e7d351c1dd8e6"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.311094 29807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "d124018c15f144dab7b2f342db1056f7"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "0bc748f732b1060a6165a47442d5e0b9"
server_key_iv: "2d1f1d1cad43c6435e6e7d351c1dd8e6"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.312464 29807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:48.313318 29834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.313536 29807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:48.313643 29807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "d124018c15f144dab7b2f342db1056f7"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "0bc748f732b1060a6165a47442d5e0b9"
server_key_iv: "2d1f1d1cad43c6435e6e7d351c1dd8e6"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.313720 29807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:48.331014 29807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:48.333703 29807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:48.333863 29807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:48.338416 29807 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:39251
I20260809 18:56:48.338455 29915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:39251 every 8 connection(s)
I20260809 18:56:48.339035 29807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:48.339779 29916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:48.342482 29916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7: Bootstrap starting.
I20260809 18:56:48.343145 29916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:48.343487 29916 log.cc:824] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:48.344240 29916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7: No bootstrap required, opened a new log
I20260809 18:56:48.344636 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 29807
I20260809 18:56:48.344733 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:48.344926 24468 external_mini_cluster.cc:1428] Setting key 21ed62dd189b2c204b4f8e5e68ffca93
I20260809 18:56:48.347076 29916 raft_consensus.cc:348] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d124018c15f144dab7b2f342db1056f7" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39251 } }
I20260809 18:56:48.347267 29916 raft_consensus.cc:374] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:48.347308 29916 raft_consensus.cc:729] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d124018c15f144dab7b2f342db1056f7, State: Initialized, Role: FOLLOWER
I20260809 18:56:48.347476 29916 consensus_queue.cc:260] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d124018c15f144dab7b2f342db1056f7" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39251 } }
I20260809 18:56:48.347549 29916 raft_consensus.cc:388] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:48.347570 29916 raft_consensus.cc:482] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:48.347635 29916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:48.348307 29916 raft_consensus.cc:504] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d124018c15f144dab7b2f342db1056f7" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39251 } }
I20260809 18:56:48.348423 29916 leader_election.cc:302] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d124018c15f144dab7b2f342db1056f7; no voters:
I20260809 18:56:48.348603 29916 leader_election.cc:288] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:48.348664 29925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:48.348850 29925 raft_consensus.cc:686] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [term 1 LEADER]: Becoming Leader. State: Replica: d124018c15f144dab7b2f342db1056f7, State: Running, Role: LEADER
I20260809 18:56:48.348877 29916 sys_catalog.cc:564] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:48.349043 29925 consensus_queue.cc:237] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d124018c15f144dab7b2f342db1056f7" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39251 } }
I20260809 18:56:48.349467 29929 sys_catalog.cc:455] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d124018c15f144dab7b2f342db1056f7. Latest consensus state: current_term: 1 leader_uuid: "d124018c15f144dab7b2f342db1056f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d124018c15f144dab7b2f342db1056f7" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39251 } } }
I20260809 18:56:48.349467 29928 sys_catalog.cc:455] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d124018c15f144dab7b2f342db1056f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d124018c15f144dab7b2f342db1056f7" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 39251 } } }
I20260809 18:56:48.349581 29929 sys_catalog.cc:458] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:48.349583 29928 sys_catalog.cc:458] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:48.350653 29935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:48.351404 29935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:48.353065 29935 catalog_manager.cc:1347] Generated new cluster ID: f9d491c811ee4e10aa46468d0db4afaa
I20260809 18:56:48.353120 29935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:48.358738 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.345529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34504 (local address 127.23.229.62:39251)
0809 18:56:48.345725 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.345742 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.345777 (+ 35us) server_negotiation.cc:407] Connection header received
0809 18:56:48.347032 (+ 1255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.347042 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.347110 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.347277 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.348124 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.349888 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.351023 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.351491 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.351599 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.354560 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.354565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.354565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:48.354580 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.356727 (+ 2147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.357169 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.357172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.357173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.357312 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.357526 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.357527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.357528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.357839 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.358020 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.358380 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.358532 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260809 18:56:48.364017 29935 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:48.364619 29935 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:48.369529 29935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d124018c15f144dab7b2f342db1056f7: Generated new TSK 0
I20260809 18:56:48.369709 29935 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:48.403004 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39251
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:48.490356 29956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:48.490594 29956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:48.490621 29956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:48.491894 29956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:48.491953 29956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:48.491981 29956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:48.493681 29956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:48.493968 29956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:48.494216 29956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:48.499902 29967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:48.499886 29964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.500214 29956 server_base.cc:1034] running on GCE node
W20260809 18:56:48.500269 29965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.500589 29956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:48.500813 29956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:48.501989 29956 hybrid_clock.cc:648] HybridClock initialized: now 1786301808501981 us; error 46 us; skew 500 ppm
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:48.504814 29956 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:48.505306 29956 webserver.cc:460] Webserver started at http://127.23.229.1:34045/ using document root <none> and password file <none>
I20260809 18:56:48.505570 29956 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:48.505643 29956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:48.505820 29956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:48.506929 29956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "103c5cba9e6744409a77ba04fca6771d"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "89ab04810bcbad00f5bd19a3f28965b1"
server_key_iv: "76368c42f19bfba6ba5b1880d1d6fb4a"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.507311 29956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "103c5cba9e6744409a77ba04fca6771d"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "89ab04810bcbad00f5bd19a3f28965b1"
server_key_iv: "76368c42f19bfba6ba5b1880d1d6fb4a"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.508776 29956 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 18:56:48.509562 29981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.509742 29956 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:48.509855 29956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "103c5cba9e6744409a77ba04fca6771d"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "89ab04810bcbad00f5bd19a3f28965b1"
server_key_iv: "76368c42f19bfba6ba5b1880d1d6fb4a"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.509931 29956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:48.544031 29956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:48.546209 29956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:48.546391 29956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:48.546667 29956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:48.547013 29956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:48.547078 29956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.547123 29956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:48.547171 29956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.553570 29956 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:37263
I20260809 18:56:48.553617 30163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:37263 every 8 connection(s)
I20260809 18:56:48.554097 29956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:48.559929 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 29956
I20260809 18:56:48.560038 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:48.560225 24468 external_mini_cluster.cc:1428] Setting key a3812eab21e1872adf973389d8a34f9b
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:48.564322 30167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.554930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:39251 (local address 127.23.229.1:52559)
0809 18:56:48.555104 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.555149 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.556093 (+ 944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.556329 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.556332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.556623 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.556826 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:48.556831 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.557516 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.557517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:48.558342 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:48.558344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.558718 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.558719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:48.558821 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.559298 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:48.559307 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.561052 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.562935 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:48.562950 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:48.562952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:48.563178 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:48.563398 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:48.563399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:48.563399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:48.563500 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:48.563794 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.563798 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.563939 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.564026 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.564155 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260809 18:56:48.564317 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.554972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:52559 (local address 127.23.229.62:39251)
0809 18:56:48.555042 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.555044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.555250 (+ 206us) server_negotiation.cc:407] Connection header received
0809 18:56:48.556192 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.556193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.556208 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.556271 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.556903 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.557420 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.558432 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.558640 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.558696 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.561148 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.561150 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.561150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:48.561159 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.562832 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.563257 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.563258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.563258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.563327 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.563565 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.563567 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.563567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.563726 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.563800 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.564073 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.564173 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:56:48.564908 30164 heartbeater.cc:347] Connected to a master server at 127.23.229.62:39251
I20260809 18:56:48.565042 30164 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:48.565236 30164 heartbeater.cc:511] Master 127.23.229.62:39251 requested a full tablet report, sending...
I20260809 18:56:48.565850 29857 ts_manager.cc:194] Registered new tserver with Master: 103c5cba9e6744409a77ba04fca6771d (127.23.229.1:37263)
I20260809 18:56:48.566812 29857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:52559
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:48.587247 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39251
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:48.672379 30171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:48.672613 30171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:48.672636 30171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:48.673810 30171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:48.673852 30171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:48.673885 30171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:48.675421 30171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:48.675669 30171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:48.675926 30171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:48.681171 30185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:48.681175 30180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.681212 30171 server_base.cc:1034] running on GCE node
W20260809 18:56:48.681195 30177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.681690 30171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:48.681969 30171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:48.683120 30171 hybrid_clock.cc:648] HybridClock initialized: now 1786301808683106 us; error 30 us; skew 500 ppm
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:48.685715 30171 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:48.686158 30171 webserver.cc:460] Webserver started at http://127.23.229.2:39499/ using document root <none> and password file <none>
I20260809 18:56:48.686410 30171 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:48.686456 30171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:48.686625 30171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:48.687704 30171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "c5241f89a31c4e56925dc14e44acc544"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "8b662547961a44ece0e343ffa8027d34"
server_key_iv: "7cebb9cdd2f1f3788f25cdcfdca1ccbc"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.688081 30171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "c5241f89a31c4e56925dc14e44acc544"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "8b662547961a44ece0e343ffa8027d34"
server_key_iv: "7cebb9cdd2f1f3788f25cdcfdca1ccbc"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.689546 30171 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:48.690267 30198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.690452 30171 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:48.690564 30171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "c5241f89a31c4e56925dc14e44acc544"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "8b662547961a44ece0e343ffa8027d34"
server_key_iv: "7cebb9cdd2f1f3788f25cdcfdca1ccbc"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.690644 30171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:48.705720 30171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:48.707753 30171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:48.707921 30171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:48.708166 30171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:48.708557 30171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:48.708612 30171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.708657 30171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:48.708684 30171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.715096 30171 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:39949
I20260809 18:56:48.715142 30384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:39949 every 8 connection(s)
I20260809 18:56:48.715516 30171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:48.722572 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 30171
I20260809 18:56:48.722688 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:48.722873 24468 external_mini_cluster.cc:1428] Setting key a14c0f6dbc306ec6cac969d58228571e
I20260809 18:56:48.725349 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.716353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:36025 (local address 127.23.229.62:39251)
0809 18:56:48.716425 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.716427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.716666 (+ 239us) server_negotiation.cc:407] Connection header received
0809 18:56:48.717707 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.717708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.717719 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.717779 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.718394 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.718942 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.719932 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.720127 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.720180 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.722262 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.722263 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.722264 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:48.722269 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.723887 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.724310 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.724312 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.724312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.724377 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.724684 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.724685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.724686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.724807 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.724888 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.725168 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.725259 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:56:48.725551 30387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.716321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:39251 (local address 127.23.229.2:36025)
0809 18:56:48.716531 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.716577 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.717606 (+ 1029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.717837 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.717840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.718108 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.718308 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:48.718312 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.719037 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.719038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:48.719845 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:48.719846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.720205 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.720206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:48.720309 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.720776 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:48.720784 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.722170 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.723974 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:48.723982 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:48.723985 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:48.724216 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:48.724452 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:48.724453 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:48.724453 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:48.724610 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:48.724883 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.724891 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.725033 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.725132 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.725293 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260809 18:56:48.726022 30385 heartbeater.cc:347] Connected to a master server at 127.23.229.62:39251
I20260809 18:56:48.726109 30385 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:48.726312 30385 heartbeater.cc:511] Master 127.23.229.62:39251 requested a full tablet report, sending...
I20260809 18:56:48.726725 29857 ts_manager.cc:194] Registered new tserver with Master: c5241f89a31c4e56925dc14e44acc544 (127.23.229.2:39949)
I20260809 18:56:48.727166 29857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:36025
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:48.751106 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39251
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:48.836159 30391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:48.836431 30391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:48.836472 30391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:48.837635 30391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:48.837718 30391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:48.837760 30391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:48.839349 30391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:39251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:48.839640 30391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:48.839895 30391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:48.845171 30397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:48.845227 30403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:48.845171 30400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.845367 30391 server_base.cc:1034] running on GCE node
I20260809 18:56:48.845677 30391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:48.845965 30391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:48.847131 30391 hybrid_clock.cc:648] HybridClock initialized: now 1786301808847104 us; error 44 us; skew 500 ppm
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:48.849804 30391 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:48.850337 30391 webserver.cc:460] Webserver started at http://127.23.229.3:42315/ using document root <none> and password file <none>
I20260809 18:56:48.850579 30391 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:48.850646 30391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:48.850750 30391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:48.851838 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "adeba13779c14c18a8c2c11fe76af01b"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "636ff14b0b93ce133ea7c5c5d9800e39"
server_key_iv: "15dfd6ee1a981482cf8921dcfc82ae5c"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.852149 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "adeba13779c14c18a8c2c11fe76af01b"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "636ff14b0b93ce133ea7c5c5d9800e39"
server_key_iv: "15dfd6ee1a981482cf8921dcfc82ae5c"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.853533 30391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:48.854254 30413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.854445 30391 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.854523 30391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "adeba13779c14c18a8c2c11fe76af01b"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-jq4t"
server_key: "636ff14b0b93ce133ea7c5c5d9800e39"
server_key_iv: "15dfd6ee1a981482cf8921dcfc82ae5c"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.854576 30391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:48.872900 30391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:48.874794 30391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:48.874915 30391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:48.875114 30391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:48.875460 30391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:48.875496 30391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.875543 30391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:48.875569 30391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.881680 30391 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:41943
I20260809 18:56:48.881726 30589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:41943 every 8 connection(s)
I20260809 18:56:48.882061 30391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:48.886680 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 30391
I20260809 18:56:48.886816 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:48.887015 24468 external_mini_cluster.cc:1428] Setting key 4945db6121b9e439148defeff3aa2413
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:48.891625 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.882805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:58107 (local address 127.23.229.62:39251)
0809 18:56:48.882895 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.882898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.883087 (+ 189us) server_negotiation.cc:407] Connection header received
0809 18:56:48.884030 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.884031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.884044 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.884101 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.884831 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.885345 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.886340 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.886600 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.886680 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.889173 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.889174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.889175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:48.889181 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.890393 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.890768 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.890769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.890769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.890836 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.891066 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.891067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.891067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.891178 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.891233 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.891479 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.891558 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 18:56:48.891825 30593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.882753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:39251 (local address 127.23.229.3:58107)
0809 18:56:48.882943 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.882983 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.883930 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.884187 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.884191 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.884464 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.884750 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:48.884756 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.885427 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.885427 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:48.886262 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:48.886265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.886694 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.886695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:48.886801 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.887479 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:48.887489 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.889082 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.890468 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:48.890474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:48.890476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:48.890698 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:48.890903 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:48.890904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:48.890904 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:48.891007 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:48.891236 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.891240 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.891363 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.891449 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.891577 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":115,"threads_started":1}
I20260809 18:56:48.892413 30591 heartbeater.cc:347] Connected to a master server at 127.23.229.62:39251
I20260809 18:56:48.892563 30591 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:48.892742 30591 heartbeater.cc:511] Master 127.23.229.62:39251 requested a full tablet report, sending...
I20260809 18:56:48.893126 29857 ts_manager.cc:194] Registered new tserver with Master: adeba13779c14c18a8c2c11fe76af01b (127.23.229.3:41943)
I20260809 18:56:48.893529 29857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:58107
I20260809 18:56:48.898907 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:48.924554 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.916653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.23.229.1:37263)
0809 18:56:48.916849 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.916855 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.916867 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:56:48.916919 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.916922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.916944 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.917037 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.917643 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.918401 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.919151 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.919482 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.919537 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.921841 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.921850 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.921851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:48.921858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.923520 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.923826 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.923829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.923830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.923887 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.924041 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.924041 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.924041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.924171 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.924271 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.924338 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.924402 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":101,"threads_started":1}
Aug 09 18:56:48 dist-test-slave-jq4t krb5kdc[29786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:48.932665 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.925931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34514 (local address 127.23.229.62:39251)
0809 18:56:48.925998 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.925999 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.926010 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:48.926039 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.926040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.926049 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.926100 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.926543 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.927040 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.927696 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:48.927913 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:48.927969 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:48.930190 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.930192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.930192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:48.930199 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.931490 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.931802 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.931803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.931803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.931876 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:48.932073 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:48.932074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:48.932075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:48.932266 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.932361 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.932452 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.932595 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 18:56:48.932971 29857 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34514
I20260809 18:56:48.933399 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 29956
I20260809 18:56:48.947108 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 30171
I20260809 18:56:48.961346 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 30391
I20260809 18:56:48.974339 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 29807
2026-08-09T18:56:48Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2147 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:49 dist-test-slave-jq4t krb5kdc[30609](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:49 dist-test-slave-jq4t krb5kdc[30609](info): set up 2 sockets
Aug 09 18:56:49 dist-test-slave-jq4t krb5kdc[30609](info): commencing operation
krb5kdc: starting...
W20260809 18:56:50.223527 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:50.351200 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:34829
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:34829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:50.439198 30630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:50.439419 30630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:50.439443 30630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:50.440582 30630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:50.440618 30630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:50.440632 30630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:50.440644 30630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:50.440657 30630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:50.442155 30630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:34829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:34829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:50.442353 30630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:50.442543 30630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:50.447672 30637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.447721 30643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.447672 30639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.447995 30630 server_base.cc:1034] running on GCE node
I20260809 18:56:50.448256 30630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:50.448606 30630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:50.449779 30630 hybrid_clock.cc:648] HybridClock initialized: now 1786301810449766 us; error 33 us; skew 500 ppm
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:50.452689 30630 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:50.453115 30630 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:50.453199 30630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:50.453385 30630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:50.454648 30630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "ff2aeb11ad2242e3843c9f78da571324"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "1ce0cefe03b9549bc3f43aa456a14aaa"
server_key_iv: "e7e6ac9196cfcfcf7645957d0ff8b7d7"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.455065 30630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "ff2aeb11ad2242e3843c9f78da571324"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "1ce0cefe03b9549bc3f43aa456a14aaa"
server_key_iv: "e7e6ac9196cfcfcf7645957d0ff8b7d7"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.456569 30630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:50.457469 30652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.457648 30630 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:50.457770 30630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "ff2aeb11ad2242e3843c9f78da571324"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "1ce0cefe03b9549bc3f43aa456a14aaa"
server_key_iv: "e7e6ac9196cfcfcf7645957d0ff8b7d7"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.457865 30630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:50.487623 30630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:50.490569 30630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:50.490756 30630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:50.495378 30630 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:34829
I20260809 18:56:50.495407 30726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:34829 every 8 connection(s)
I20260809 18:56:50.495772 30630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:50.496910 30728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:50.497526 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 30630
I20260809 18:56:50.497629 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:50.497844 24468 external_mini_cluster.cc:1428] Setting key 36cae4d429937eb1e9de108e7c8b6080
I20260809 18:56:50.500284 30728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324: Bootstrap starting.
I20260809 18:56:50.501133 30728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:50.501451 30728 log.cc:824] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:50.502239 30728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324: No bootstrap required, opened a new log
I20260809 18:56:50.504578 30728 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff2aeb11ad2242e3843c9f78da571324" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34829 } }
I20260809 18:56:50.504727 30728 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:50.504756 30728 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2aeb11ad2242e3843c9f78da571324, State: Initialized, Role: FOLLOWER
I20260809 18:56:50.504909 30728 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff2aeb11ad2242e3843c9f78da571324" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34829 } }
I20260809 18:56:50.505018 30728 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:50.505065 30728 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:50.505120 30728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:50.505841 30728 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff2aeb11ad2242e3843c9f78da571324" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34829 } }
I20260809 18:56:50.505996 30728 leader_election.cc:302] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff2aeb11ad2242e3843c9f78da571324; no voters:
I20260809 18:56:50.506189 30728 leader_election.cc:288] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:50.506261 30735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:50.506412 30735 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [term 1 LEADER]: Becoming Leader. State: Replica: ff2aeb11ad2242e3843c9f78da571324, State: Running, Role: LEADER
I20260809 18:56:50.506516 30728 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:50.506552 30735 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff2aeb11ad2242e3843c9f78da571324" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34829 } }
I20260809 18:56:50.506939 30735 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff2aeb11ad2242e3843c9f78da571324. Latest consensus state: current_term: 1 leader_uuid: "ff2aeb11ad2242e3843c9f78da571324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff2aeb11ad2242e3843c9f78da571324" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34829 } } }
I20260809 18:56:50.507107 30735 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:50.506985 30737 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff2aeb11ad2242e3843c9f78da571324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff2aeb11ad2242e3843c9f78da571324" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34829 } } }
I20260809 18:56:50.507390 30737 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:50.508029 30747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:50.508671 30747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:50.510120 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:50.498460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50892 (local address 127.23.229.62:34829)
0809 18:56:50.498678 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:50.498689 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:50.498730 (+ 41us) server_negotiation.cc:407] Connection header received
0809 18:56:50.499284 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:50.499294 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:50.499362 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:50.499555 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:50.500254 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.501779 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.502641 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.503265 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.503378 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.505947 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:50.505953 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:50.505953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:50.505967 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:50.508256 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:50.508741 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:50.508745 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:50.508746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:50.508885 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:50.509125 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:50.509126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:50.509127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:50.509418 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:50.509586 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:50.509720 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 18:56:50.509883 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":86,"threads_started":1}
I20260809 18:56:50.510607 30747 catalog_manager.cc:1347] Generated new cluster ID: 98659cd7c34140f3a389676caed23991
I20260809 18:56:50.510655 30747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:50.543689 30747 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:50.544337 30747 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:50.551337 30747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324: Generated new TSK 0
I20260809 18:56:50.551579 30747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:50.587613 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:34829
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:50.674947 30768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:50.675158 30768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:50.675184 30768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:50.676276 30768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:50.676311 30768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:50.676337 30768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:50.677793 30768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:50.677999 30768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:50.678169 30768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:50.683274 30780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.683275 30783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.683306 30777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.683498 30768 server_base.cc:1034] running on GCE node
I20260809 18:56:50.683722 30768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:50.683993 30768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:50.685159 30768 hybrid_clock.cc:648] HybridClock initialized: now 1786301810685144 us; error 45 us; skew 500 ppm
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:50.687701 30768 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:50.688066 30768 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:50.688139 30768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:50.688293 30768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:50.689638 30768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "da83510a06933ed6cc8b12ade4e2cf1e"
server_key_iv: "2d67b2e486fe537b0694d0e722094dd1"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.690042 30768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "da83510a06933ed6cc8b12ade4e2cf1e"
server_key_iv: "2d67b2e486fe537b0694d0e722094dd1"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.691406 30768 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:50.692144 30790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.692317 30768 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:50.692426 30768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "da83510a06933ed6cc8b12ade4e2cf1e"
server_key_iv: "2d67b2e486fe537b0694d0e722094dd1"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.692543 30768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:50.701630 30768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:50.704000 30768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:50.704169 30768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:50.704413 30768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:50.704766 30768 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:50.704830 30768 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.704895 30768 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:50.704926 30768 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.711323 30768 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:45791
I20260809 18:56:50.711372 30950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:45791 every 8 connection(s)
I20260809 18:56:50.711663 30768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:50.713421 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 30768
I20260809 18:56:50.713543 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:50.713752 24468 external_mini_cluster.cc:1428] Setting key f0a97b202cb914fce6a13887cec8e534
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:50.722479 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:50.712425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:46907 (local address 127.23.229.62:34829)
0809 18:56:50.712535 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:50.712537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:50.712728 (+ 191us) server_negotiation.cc:407] Connection header received
0809 18:56:50.713238 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:50.713239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:50.713253 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:50.713344 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:50.714548 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.715321 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.716409 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.716732 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.716820 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.719359 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:50.719360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:50.719361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:50.719369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:50.720958 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:50.721413 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:50.721415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:50.721415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:50.721483 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:50.721749 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:50.721750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:50.721750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:50.721889 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:50.721966 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:50.722273 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 18:56:50.722384 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 18:56:50.722678 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:50.712415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:34829 (local address 127.23.229.1:46907)
0809 18:56:50.712593 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:50.712636 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:50.713135 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:50.713398 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:50.713401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:50.713744 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:50.714343 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:50.714350 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.715435 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.715436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:50.716291 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:50.716293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.716842 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.716843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:50.716975 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.717557 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:50.717566 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:50.719240 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:50.721069 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:50.721078 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:50.721080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:50.721318 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:50.721555 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:50.721556 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:50.721556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:50.721679 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:50.721969 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:50.721977 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:50.722133 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 18:56:50.722248 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 18:56:50.722420 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260809 18:56:50.723308 30951 heartbeater.cc:347] Connected to a master server at 127.23.229.62:34829
I20260809 18:56:50.723433 30951 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:50.723637 30951 heartbeater.cc:511] Master 127.23.229.62:34829 requested a full tablet report, sending...
I20260809 18:56:50.724231 30675 ts_manager.cc:194] Registered new tserver with Master: 4930b3379e3e48eb9ab0b6e17aae1e2c (127.23.229.1:45791)
I20260809 18:56:50.725021 30675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:46907
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:50.741683 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:34829
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:50.828469 30968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:50.828795 30968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:50.828827 30968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:50.829994 30968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:50.830035 30968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:50.830061 30968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:50.831633 30968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:50.831854 30968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:50.832067 30968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:50.837339 30977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.837348 30974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.837603 30968 server_base.cc:1034] running on GCE node
W20260809 18:56:50.837495 30973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.837932 30968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:50.838210 30968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:50.839383 30968 hybrid_clock.cc:648] HybridClock initialized: now 1786301810839380 us; error 36 us; skew 500 ppm
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:50.842063 30968 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:50.842393 30968 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:50.842437 30968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:50.842537 30968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:50.843581 30968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "d01d463ce6994e88941af523ff5c1bbc"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "f122057838b2a6cadba4f39bcdf0d9d5"
server_key_iv: "85a60fe7f4f8462f1fbb1bef001432ba"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.843891 30968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "d01d463ce6994e88941af523ff5c1bbc"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "f122057838b2a6cadba4f39bcdf0d9d5"
server_key_iv: "85a60fe7f4f8462f1fbb1bef001432ba"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.845345 30968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:50.846117 30986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.846318 30968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:50.846416 30968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "d01d463ce6994e88941af523ff5c1bbc"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "f122057838b2a6cadba4f39bcdf0d9d5"
server_key_iv: "85a60fe7f4f8462f1fbb1bef001432ba"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.846494 30968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:50.856031 30968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:50.858098 30968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:50.858261 30968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:50.858491 30968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:50.858822 30968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:50.858857 30968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.858879 30968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:50.858929 30968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.865480 30968 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:37153
I20260809 18:56:50.865553 31154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:37153 every 8 connection(s)
I20260809 18:56:50.865841 30968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:50.867738 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 30968
I20260809 18:56:50.867856 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:50.868063 24468 external_mini_cluster.cc:1428] Setting key db082f5212988ce0f18ed9b1e7daf3ff
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:50.877271 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:50.866769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43597 (local address 127.23.229.62:34829)
0809 18:56:50.866864 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:50.866871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:50.867069 (+ 198us) server_negotiation.cc:407] Connection header received
0809 18:56:50.867576 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:50.867577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:50.867587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:50.867638 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:50.869118 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.869627 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.871168 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.871512 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.871595 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.873979 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:50.873982 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:50.873982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:50.873992 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:50.875757 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:50.876183 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:50.876184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:50.876184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:50.876255 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:50.876531 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:50.876532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:50.876532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:50.876699 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:50.876778 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:50.877060 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 18:56:50.877160 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:56:50.877367 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:50.866746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:34829 (local address 127.23.229.2:43597)
0809 18:56:50.866920 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:50.866965 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:50.867461 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:50.867733 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:50.867737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:50.868156 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:50.869005 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:50.869014 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.869735 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.869736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:50.871066 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:50.871070 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.871607 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.871608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:50.871712 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.872336 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:50.872346 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:50.873871 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:50.875852 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:50.875860 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:50.875862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:50.876102 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:50.876330 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:50.876331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:50.876331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:50.876433 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:50.876781 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:50.876787 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:50.876920 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 18:56:50.877015 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 18:56:50.877154 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260809 18:56:50.877971 31155 heartbeater.cc:347] Connected to a master server at 127.23.229.62:34829
I20260809 18:56:50.878072 31155 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:50.878257 31155 heartbeater.cc:511] Master 127.23.229.62:34829 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
I20260809 18:56:50.878741 30675 ts_manager.cc:194] Registered new tserver with Master: d01d463ce6994e88941af523ff5c1bbc (127.23.229.2:37153)
I20260809 18:56:50.879117 30675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:43597
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:50.896054 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:34829
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:50.982249 31162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:50.982467 31162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:50.982502 31162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:50.983691 31162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:50.983737 31162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:50.983764 31162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:50.985438 31162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:50.985713 31162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:50.985953 31162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:50.991344 31176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.991336 31169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.991616 31162 server_base.cc:1034] running on GCE node
W20260809 18:56:50.991339 31171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.992007 31162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:50.992281 31162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:50.993427 31162 hybrid_clock.cc:648] HybridClock initialized: now 1786301810993410 us; error 35 us; skew 500 ppm
Aug 09 18:56:50 dist-test-slave-jq4t krb5kdc[30609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:50.996234 31162 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:50.996675 31162 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:50.996752 31162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:50.996912 31162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:50.998020 31162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "676cc39821174f288d315a06786d78c2"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "810c1dcc0bec394c252294ac3c423d24"
server_key_iv: "b0c4937ceb1a7236f0ddc4b2eb5fdc2a"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.998404 31162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "676cc39821174f288d315a06786d78c2"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "810c1dcc0bec394c252294ac3c423d24"
server_key_iv: "b0c4937ceb1a7236f0ddc4b2eb5fdc2a"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.999774 31162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:51.000620 31186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.000814 31162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:51.000926 31162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "676cc39821174f288d315a06786d78c2"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-jq4t"
server_key: "810c1dcc0bec394c252294ac3c423d24"
server_key_iv: "b0c4937ceb1a7236f0ddc4b2eb5fdc2a"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.001022 31162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:51.009522 31162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:51.011853 31162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:51.012025 31162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:51.012261 31162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:51.012681 31162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:51.012718 31162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.012742 31162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:51.012784 31162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.018608 31162 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:33037
I20260809 18:56:51.018678 31350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:33037 every 8 connection(s)
I20260809 18:56:51.018978 31162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:51.021852 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 31162
I20260809 18:56:51.021938 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:51.022113 24468 external_mini_cluster.cc:1428] Setting key ab2637e621c613660f08be861668170e
Aug 09 18:56:51 dist-test-slave-jq4t krb5kdc[30609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301810, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:51.028714 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.019754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:57835 (local address 127.23.229.62:34829)
0809 18:56:51.019809 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.019811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.020024 (+ 213us) server_negotiation.cc:407] Connection header received
0809 18:56:51.020541 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.020541 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.020552 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.020607 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.021628 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.022301 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.023612 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.023805 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.023861 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.026106 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.026108 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.026108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:51.026116 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.027404 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:51.027801 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:51.027802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:51.027802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:51.027856 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:51.028080 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:51.028080 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:51.028080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:51.028188 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.028240 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.028566 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.028645 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:56:51.028873 31354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.019705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:34829 (local address 127.23.229.3:57835)
0809 18:56:51.019875 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.019920 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.020407 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.020686 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.020690 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.020964 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.021508 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.021514 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.022426 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.022427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.023531 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.023534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.023881 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.023881 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.023985 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.024532 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:51.024543 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.026013 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.027501 (+ 1488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:51.027508 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:51.027511 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:51.027736 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:51.027916 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:51.027916 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:51.027917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:51.028023 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:51.028245 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.028249 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.028373 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.028458 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.028661 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260809 18:56:51.029441 31352 heartbeater.cc:347] Connected to a master server at 127.23.229.62:34829
I20260809 18:56:51.029565 31352 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:51.029728 31352 heartbeater.cc:511] Master 127.23.229.62:34829 requested a full tablet report, sending...
I20260809 18:56:51.030148 30675 ts_manager.cc:194] Registered new tserver with Master: 676cc39821174f288d315a06786d78c2 (127.23.229.3:33037)
I20260809 18:56:51.030498 30675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:57835
I20260809 18:56:51.033844 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:56:51.040937 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.035341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.23.229.62:34829)
0809 18:56:51.035395 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.035397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.035412 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:56:51.035431 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.035432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.035440 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.035491 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.036043 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.036572 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.037267 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.037445 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.037495 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.038697 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.038698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.038698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:51.038703 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.039896 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:51.040210 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:51.040211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:51.040211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:51.040263 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:51.040424 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:51.040424 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:51.040424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:51.040631 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.040709 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.040810 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.040872 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:56:51.042806 30675 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:51.044526 30675 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:51.051694 31367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.046957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:33037 (local address 127.0.0.1:45692)
0809 18:56:51.047238 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.047251 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.047305 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.047827 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.047831 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.047835 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:51.047930 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.047932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.049410 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.049411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.050538 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.050540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.051403 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.051405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.051476 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.051481 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.051540 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.051610 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":25,"thread_start_us":72,"threads_started":1}
I20260809 18:56:51.051707 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.047398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56672 (local address 127.23.229.2:37153)
0809 18:56:51.047603 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.047610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.047624 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:56:51.047683 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.047686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.047703 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.047784 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:51.048050 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.048939 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.050451 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.051244 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.051334 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.051410 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.051569 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.051612 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":105,"threads_started":1}
I20260809 18:56:51.051821 31368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.047142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45692 (local address 127.23.229.3:33037)
0809 18:56:51.047643 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.047648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.047658 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:56:51.047697 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.047699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.047713 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.048019 (+ 306us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:51.048103 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.049257 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.050612 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.051291 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.051591 (+ 300us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.051660 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.051683 (+ 23us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.051728 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":95,"threads_started":1}
I20260809 18:56:51.052186 31366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.046996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:37153 (local address 127.0.0.1:56672)
0809 18:56:51.047456 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.047465 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.047529 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.047892 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.047893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.047895 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:51.047963 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.047964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.049038 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.049039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.050355 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.050358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.051345 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.051346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.051441 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.051459 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.051536 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.052116 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":45,"threads_started":1}
I20260809 18:56:51.052567 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.046956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:45791 (local address 127.0.0.1:33410)
0809 18:56:51.047079 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.047122 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.047197 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.047830 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.047830 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.047833 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:51.047930 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.047933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.050619 (+ 2686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.050620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.051280 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.051281 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.052293 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.052295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.052356 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.052359 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.052388 (+ 29us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.052430 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":4,"thread_start_us":82,"threads_started":1}
I20260809 18:56:51.052945 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.047264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33410 (local address 127.23.229.1:45791)
0809 18:56:51.047481 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.047486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.047498 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:56:51.047678 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.047681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.047701 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.048018 (+ 317us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:51.048103 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.049256 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.051399 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.052181 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.052741 (+ 560us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.052814 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.052840 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.052884 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":107,"threads_started":1}
I20260809 18:56:51.052866 31252 tablet_service.cc:1467] Processing CreateTablet for tablet 5d4c4400a0a041c7883ba34bd03d6419 (DEFAULT_TABLE table=test-table [id=3182533a9b594ca3a7f4434fb1dc5da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:51.053248 31252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d4c4400a0a041c7883ba34bd03d6419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.053596 30856 tablet_service.cc:1467] Processing CreateTablet for tablet 5d4c4400a0a041c7883ba34bd03d6419 (DEFAULT_TABLE table=test-table [id=3182533a9b594ca3a7f4434fb1dc5da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:51.053910 30856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d4c4400a0a041c7883ba34bd03d6419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.056164 31371 tablet_bootstrap.cc:492] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Bootstrap starting.
I20260809 18:56:51.056623 31373 tablet_bootstrap.cc:492] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c: Bootstrap starting.
I20260809 18:56:51.056699 31061 tablet_service.cc:1467] Processing CreateTablet for tablet 5d4c4400a0a041c7883ba34bd03d6419 (DEFAULT_TABLE table=test-table [id=3182533a9b594ca3a7f4434fb1dc5da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:51.056926 31371 tablet_bootstrap.cc:654] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.057049 31061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d4c4400a0a041c7883ba34bd03d6419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.057327 31373 tablet_bootstrap.cc:654] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.057544 31371 log.cc:824] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.057952 31373 log.cc:824] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.058430 31371 tablet_bootstrap.cc:492] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: No bootstrap required, opened a new log
I20260809 18:56:51.058610 31371 ts_tablet_manager.cc:1397] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 18:56:51.058926 31373 tablet_bootstrap.cc:492] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c: No bootstrap required, opened a new log
I20260809 18:56:51.059012 31373 ts_tablet_manager.cc:1397] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:51.060541 31377 tablet_bootstrap.cc:492] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Bootstrap starting.
I20260809 18:56:51.060431 31373 raft_consensus.cc:348] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.060642 31373 raft_consensus.cc:374] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.060684 31373 raft_consensus.cc:729] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4930b3379e3e48eb9ab0b6e17aae1e2c, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.060809 31373 consensus_queue.cc:260] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.060868 31371 raft_consensus.cc:348] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.061029 31371 raft_consensus.cc:374] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.061074 31371 raft_consensus.cc:729] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 676cc39821174f288d315a06786d78c2, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.061120 31373 ts_tablet_manager.cc:1428] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:51.061192 31371 consensus_queue.cc:260] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.061295 30951 heartbeater.cc:503] Master 127.23.229.62:34829 was elected leader, sending a full tablet report...
I20260809 18:56:51.061476 31377 tablet_bootstrap.cc:654] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.061479 31371 ts_tablet_manager.cc:1428] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:51.061524 31352 heartbeater.cc:503] Master 127.23.229.62:34829 was elected leader, sending a full tablet report...
I20260809 18:56:51.062124 31377 log.cc:824] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.062955 31377 tablet_bootstrap.cc:492] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: No bootstrap required, opened a new log
I20260809 18:56:51.063045 31377 ts_tablet_manager.cc:1397] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:51.064394 31377 raft_consensus.cc:348] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.064600 31377 raft_consensus.cc:374] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.064630 31377 raft_consensus.cc:729] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01d463ce6994e88941af523ff5c1bbc, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.064713 31377 consensus_queue.cc:260] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.064985 31377 ts_tablet_manager.cc:1428] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:51.065008 31155 heartbeater.cc:503] Master 127.23.229.62:34829 was elected leader, sending a full tablet report...
I20260809 18:56:51.112375 31379 raft_consensus.cc:482] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:51.112541 31379 raft_consensus.cc:504] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.112982 31379 leader_election.cc:288] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 676cc39821174f288d315a06786d78c2 (127.23.229.3:33037), d01d463ce6994e88941af523ff5c1bbc (127.23.229.2:37153)
W20260809 18:56:51.116442 31156 tablet.cc:2369] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:51.117178 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.113323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:37173 (local address 127.23.229.2:37153)
0809 18:56:51.113378 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.113381 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.113548 (+ 167us) server_negotiation.cc:407] Connection header received
0809 18:56:51.113583 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.113584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.113592 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.113637 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:51.113807 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.114505 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.116167 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.116772 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.116851 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.116861 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.117065 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.117110 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:56:51.117179 31368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.113323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:51351 (local address 127.23.229.3:33037)
0809 18:56:51.113389 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.113391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.113400 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:51.113426 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.113426 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.113435 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.113483 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:51.113712 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.114503 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.116165 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.116772 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.116851 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.116861 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.117065 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.117109 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:56:51.117187 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.113160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:33037 (local address 127.23.229.1:51351)
0809 18:56:51.113217 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.113233 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.113285 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.113520 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.113522 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.113524 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:51.113612 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.113613 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.114605 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.114606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.116060 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.116064 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.116863 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.116864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.116966 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.116968 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.117022 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.117072 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":125}
I20260809 18:56:51.117193 31385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.113212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:37153 (local address 127.23.229.1:37173)
0809 18:56:51.113438 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.113447 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.113533 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.113664 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.113665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.113667 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:51.113735 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.113737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.114605 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.114606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.116060 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.116064 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.116863 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.116864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.116949 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.116954 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.117022 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.117072 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":83,"thread_start_us":137,"threads_started":1}
I20260809 18:56:51.117525 31090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d4c4400a0a041c7883ba34bd03d6419" candidate_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01d463ce6994e88941af523ff5c1bbc" is_pre_election: true
I20260809 18:56:51.117524 31277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d4c4400a0a041c7883ba34bd03d6419" candidate_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "676cc39821174f288d315a06786d78c2" is_pre_election: true
I20260809 18:56:51.117690 31277 raft_consensus.cc:2454] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4930b3379e3e48eb9ab0b6e17aae1e2c in term 0.
I20260809 18:56:51.117690 31090 raft_consensus.cc:2454] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4930b3379e3e48eb9ab0b6e17aae1e2c in term 0.
I20260809 18:56:51.117951 30795 leader_election.cc:302] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4930b3379e3e48eb9ab0b6e17aae1e2c, d01d463ce6994e88941af523ff5c1bbc; no voters:
I20260809 18:56:51.118120 31379 raft_consensus.cc:2781] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:51.118228 31379 raft_consensus.cc:482] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:51.118268 31379 raft_consensus.cc:3037] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.119002 31379 raft_consensus.cc:504] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.119170 31379 leader_election.cc:288] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [CANDIDATE]: Term 1 election: Requested vote from peers 676cc39821174f288d315a06786d78c2 (127.23.229.3:33037), d01d463ce6994e88941af523ff5c1bbc (127.23.229.2:37153)
I20260809 18:56:51.119329 31277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d4c4400a0a041c7883ba34bd03d6419" candidate_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "676cc39821174f288d315a06786d78c2"
I20260809 18:56:51.119338 31090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d4c4400a0a041c7883ba34bd03d6419" candidate_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01d463ce6994e88941af523ff5c1bbc"
I20260809 18:56:51.119412 31090 raft_consensus.cc:3037] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.119412 31277 raft_consensus.cc:3037] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.120307 31277 raft_consensus.cc:2454] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4930b3379e3e48eb9ab0b6e17aae1e2c in term 1.
I20260809 18:56:51.120317 31090 raft_consensus.cc:2454] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4930b3379e3e48eb9ab0b6e17aae1e2c in term 1.
I20260809 18:56:51.120527 30794 leader_election.cc:302] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4930b3379e3e48eb9ab0b6e17aae1e2c, 676cc39821174f288d315a06786d78c2; no voters:
I20260809 18:56:51.120630 31379 raft_consensus.cc:2781] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:51.120832 31379 raft_consensus.cc:686] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [term 1 LEADER]: Becoming Leader. State: Replica: 4930b3379e3e48eb9ab0b6e17aae1e2c, State: Running, Role: LEADER
I20260809 18:56:51.120947 31379 consensus_queue.cc:237] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } }
I20260809 18:56:51.121863 30673 catalog_manager.cc:5495] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4930b3379e3e48eb9ab0b6e17aae1e2c (127.23.229.1). New cstate: current_term: 1 leader_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4930b3379e3e48eb9ab0b6e17aae1e2c" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:51.144126 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.141468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33420 (local address 127.23.229.1:45791)
0809 18:56:51.141540 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.141542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.141553 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:51.141671 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.141672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.141695 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.141781 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:51.141947 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.142440 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.143274 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.143473 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.143553 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.143744 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:51.143863 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:51.143967 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.143987 (+ 20us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.144009 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 18:56:51.146281 31090 raft_consensus.cc:1261] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 1 FOLLOWER]: Refusing update from remote peer 4930b3379e3e48eb9ab0b6e17aae1e2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:51.146266 31277 raft_consensus.cc:1261] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 1 FOLLOWER]: Refusing update from remote peer 4930b3379e3e48eb9ab0b6e17aae1e2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:51.146651 31379 consensus_queue.cc:1035] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01d463ce6994e88941af523ff5c1bbc" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:51.146840 31388 consensus_queue.cc:1035] T 5d4c4400a0a041c7883ba34bd03d6419 P 4930b3379e3e48eb9ab0b6e17aae1e2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "676cc39821174f288d315a06786d78c2" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:51.150208 31394 mvcc.cc:205] Tried to move back new op lower bound from 7316692218452025344 to 7316692218352115712. Current Snapshot: MvccSnapshot[applied={T|T < 7316692218452025344 or (T in {7316692218452025344})}]
I20260809 18:56:51.151914 30673 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:51.152007 30673 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:51.152877 30673 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff2aeb11ad2242e3843c9f78da571324: Sending DeleteTablet for 3 replicas of tablet 5d4c4400a0a041c7883ba34bd03d6419
I20260809 18:56:51.153249 30856 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d4c4400a0a041c7883ba34bd03d6419 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:51 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:33410
I20260809 18:56:51.153311 31252 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d4c4400a0a041c7883ba34bd03d6419 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:51 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:45692
I20260809 18:56:51.153537 31410 tablet_replica.cc:330] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: stopping tablet replica
I20260809 18:56:51.153543 31061 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d4c4400a0a041c7883ba34bd03d6419 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:51 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:56672
I20260809 18:56:51.153647 31410 raft_consensus.cc:2229] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:51.153781 31410 raft_consensus.cc:2258] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:51.153800 31412 tablet_replica.cc:330] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: stopping tablet replica
I20260809 18:56:51.153998 31412 raft_consensus.cc:2229] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:51.154018 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 30768
I20260809 18:56:51.160792 31410 ts_tablet_manager.cc:1905] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:51.161496 31412 raft_consensus.cc:2258] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:51.163373 31410 ts_tablet_manager.cc:1918] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:51.163477 31410 log.cc:1196] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/5d4c4400a0a041c7883ba34bd03d6419
I20260809 18:56:51.163888 31410 ts_tablet_manager.cc:1939] T 5d4c4400a0a041c7883ba34bd03d6419 P 676cc39821174f288d315a06786d78c2: Deleting consensus metadata
I20260809 18:56:51.167585 31412 ts_tablet_manager.cc:1905] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:51.167568 30655 catalog_manager.cc:4841] TS 676cc39821174f288d315a06786d78c2 (127.23.229.3:33037): tablet 5d4c4400a0a041c7883ba34bd03d6419 (table test-table [id=3182533a9b594ca3a7f4434fb1dc5da9]) successfully deleted
I20260809 18:56:51.168974 31412 ts_tablet_manager.cc:1918] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:51.169082 31412 log.cc:1196] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/5d4c4400a0a041c7883ba34bd03d6419
I20260809 18:56:51.169340 31412 ts_tablet_manager.cc:1939] T 5d4c4400a0a041c7883ba34bd03d6419 P d01d463ce6994e88941af523ff5c1bbc: Deleting consensus metadata
I20260809 18:56:51.169817 30657 catalog_manager.cc:4841] TS d01d463ce6994e88941af523ff5c1bbc (127.23.229.2:37153): tablet 5d4c4400a0a041c7883ba34bd03d6419 (table test-table [id=3182533a9b594ca3a7f4434fb1dc5da9]) successfully deleted
W20260809 18:56:51.172554 30653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:45791 (error 108)
I20260809 18:56:51.172789 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 30968
I20260809 18:56:51.178457 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.172965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:45791 (local address 127.0.0.1:33436)
0809 18:56:51.178328 (+ 5363us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.178406 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:45791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5334}
W20260809 18:56:51.179100 30653 catalog_manager.cc:4584] TS 4930b3379e3e48eb9ab0b6e17aae1e2c (127.23.229.1:45791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5d4c4400a0a041c7883ba34bd03d6419: Network error: Client connection negotiation failed: client connection to 127.23.229.1:45791: connect: Connection refused (error 111)
I20260809 18:56:51.185845 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 31162
I20260809 18:56:51.205324 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 30630
2026-08-09T18:56:51Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2232 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T18:56:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:51Z Disabled control of system clock
I20260809 18:56:51.243862 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:32917
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:32917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:51.328631 31420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:51.328846 31420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:51.328869 31420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:51.330088 31420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:51.330140 31420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:51.330152 31420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:51.330165 31420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:51.330178 31420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:51.331624 31420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:32917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:32917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:51.331916 31420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:51.332260 31420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:51.337311 31426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.337309 31429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.337361 31427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:51.337677 31420 server_base.cc:1034] running on GCE node
I20260809 18:56:51.337990 31420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:51.338322 31420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:51.339488 31420 hybrid_clock.cc:648] HybridClock initialized: now 1786301811339469 us; error 29 us; skew 500 ppm
I20260809 18:56:51.345016 31420 webserver.cc:460] Webserver started at http://127.23.229.62:35579/ using document root <none> and password file <none>
I20260809 18:56:51.345348 31420 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:51.345402 31420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:51.345593 31420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:51.346758 31420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "0db272b01c104238aab9335c14586d32"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "ecb65198091f2b10e7c9eb207e122143"
server_key_iv: "324a95d2f2c5368c38f942827a95c195"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.347152 31420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "0db272b01c104238aab9335c14586d32"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "ecb65198091f2b10e7c9eb207e122143"
server_key_iv: "324a95d2f2c5368c38f942827a95c195"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.348624 31420 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:51.349431 31445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.349635 31420 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:51.349735 31420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "0db272b01c104238aab9335c14586d32"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "ecb65198091f2b10e7c9eb207e122143"
server_key_iv: "324a95d2f2c5368c38f942827a95c195"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.349815 31420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:51.353377 31420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:51.353653 31420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:51.353796 31420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:51.357995 31420 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:32917
I20260809 18:56:51.358033 31529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:32917 every 8 connection(s)
I20260809 18:56:51.358386 31420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:51.358593 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 31420
I20260809 18:56:51.358712 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:51.358887 24468 external_mini_cluster.cc:1428] Setting key c69c7bb22335013acde3c10a54380b69
I20260809 18:56:51.359186 31530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.361593 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.359450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52114 (local address 127.23.229.62:32917)
0809 18:56:51.359673 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.359681 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.359706 (+ 25us) server_negotiation.cc:407] Connection header received
0809 18:56:51.360133 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.360139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.360177 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.360293 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.361063 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.361066 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.361067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.361071 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.361113 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.361123 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.361180 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.361273 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.361346 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
I20260809 18:56:51.362813 31530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32: Bootstrap starting.
I20260809 18:56:51.363425 31530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.363706 31530 log.cc:824] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.364413 31530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32: No bootstrap required, opened a new log
I20260809 18:56:51.365928 31530 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db272b01c104238aab9335c14586d32" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 32917 } }
I20260809 18:56:51.366060 31530 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.366081 31530 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db272b01c104238aab9335c14586d32, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.366222 31530 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db272b01c104238aab9335c14586d32" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 32917 } }
I20260809 18:56:51.366324 31530 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:51.366354 31530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:51.366394 31530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.367031 31530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db272b01c104238aab9335c14586d32" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 32917 } }
I20260809 18:56:51.367168 31530 leader_election.cc:302] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0db272b01c104238aab9335c14586d32; no voters:
I20260809 18:56:51.367347 31530 leader_election.cc:288] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:51.367659 31530 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:51.367724 31542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:51.367906 31542 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [term 1 LEADER]: Becoming Leader. State: Replica: 0db272b01c104238aab9335c14586d32, State: Running, Role: LEADER
I20260809 18:56:51.368010 31542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db272b01c104238aab9335c14586d32" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 32917 } }
I20260809 18:56:51.368595 31542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0db272b01c104238aab9335c14586d32. Latest consensus state: current_term: 1 leader_uuid: "0db272b01c104238aab9335c14586d32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db272b01c104238aab9335c14586d32" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 32917 } } }
I20260809 18:56:51.368685 31542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:51.368850 31543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0db272b01c104238aab9335c14586d32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db272b01c104238aab9335c14586d32" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 32917 } } }
I20260809 18:56:51.368923 31543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:51.369050 31556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:51.369706 31556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:51.371323 31556 catalog_manager.cc:1347] Generated new cluster ID: 55791ea5f5fc4553951bf1eff8ee31b1
I20260809 18:56:51.371376 31556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:51.382956 31556 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:51.383163 31556 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:51.388923 31556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32: Generated new TSK 0
I20260809 18:56:51.389196 31556 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:51.398880 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:32917
--builtin_ntp_servers=127.23.229.20:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:51.505899 31574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:51.506127 31574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:51.506151 31574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:51.507368 31574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:51.507412 31574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:51.507439 31574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:51.508926 31574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:32917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:51.509199 31574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:51.509518 31574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:51.515064 31579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:51.515117 31574 server_base.cc:1034] running on GCE node
W20260809 18:56:51.515070 31580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.515352 31583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:51.515578 31574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:51.515842 31574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:51.517017 31574 hybrid_clock.cc:648] HybridClock initialized: now 1786301811516997 us; error 41 us; skew 500 ppm
I20260809 18:56:51.518417 31574 webserver.cc:460] Webserver started at http://127.23.229.1:37333/ using document root <none> and password file <none>
I20260809 18:56:51.518673 31574 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:51.518744 31574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:51.518903 31574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:51.520074 31574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "b25304d6355f4163a809354d3389118b"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "f8fc986423cf601382b72d7741da5bba"
server_key_iv: "85003b4a24dba497f79886b3a265d5ca"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.520463 31574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "b25304d6355f4163a809354d3389118b"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "f8fc986423cf601382b72d7741da5bba"
server_key_iv: "85003b4a24dba497f79886b3a265d5ca"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.521996 31574 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:51.522847 31592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.523092 31574 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:51.523200 31574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "b25304d6355f4163a809354d3389118b"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "f8fc986423cf601382b72d7741da5bba"
server_key_iv: "85003b4a24dba497f79886b3a265d5ca"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.523284 31574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:51.528014 31574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:51.528311 31574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:51.528438 31574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:51.528685 31574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:51.529055 31574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:51.529109 31574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.529156 31574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:51.529181 31574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.536190 31574 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:33109
I20260809 18:56:51.536253 31758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:33109 every 8 connection(s)
I20260809 18:56:51.536654 31574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:51.539929 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.537448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:37161 (local address 127.23.229.62:32917)
0809 18:56:51.537511 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.537513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.537773 (+ 260us) server_negotiation.cc:407] Connection header received
0809 18:56:51.538306 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.538307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.538315 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.538374 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.539636 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.539637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.539638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.539644 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.539667 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.539671 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.539736 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.539833 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.539851 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:56:51.540169 31762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.537456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:32917 (local address 127.23.229.1:37161)
0809 18:56:51.537652 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.537687 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.538190 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.538457 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.538461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.538469 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.539448 (+ 979us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.539449 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.539480 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.539519 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.539735 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.539743 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.539747 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.539845 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.539912 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":73,"threads_started":1}
I20260809 18:56:51.540798 31760 heartbeater.cc:347] Connected to a master server at 127.23.229.62:32917
I20260809 18:56:51.540915 31760 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:51.541080 31760 heartbeater.cc:511] Master 127.23.229.62:32917 requested a full tablet report, sending...
I20260809 18:56:51.541635 31476 ts_manager.cc:194] Registered new tserver with Master: b25304d6355f4163a809354d3389118b (127.23.229.1:33109)
I20260809 18:56:51.545900 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 31574
I20260809 18:56:51.545991 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:51.546135 24468 external_mini_cluster.cc:1428] Setting key d2d6b24e09e54a39a89d075d6bf07190
I20260809 18:56:51.547068 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:32917
--builtin_ntp_servers=127.23.229.20:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:51.632753 31763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:51.632966 31763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:51.632992 31763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:51.634100 31763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:51.634136 31763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:51.634161 31763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:51.635533 31763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:32917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:51.635730 31763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:51.635979 31763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:51.641155 31769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.641175 31773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:51.641212 31763 server_base.cc:1034] running on GCE node
W20260809 18:56:51.641147 31770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:51.641590 31763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:51.641847 31763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:51.643036 31763 hybrid_clock.cc:648] HybridClock initialized: now 1786301811643029 us; error 37 us; skew 500 ppm
I20260809 18:56:51.644387 31763 webserver.cc:460] Webserver started at http://127.23.229.2:46865/ using document root <none> and password file <none>
I20260809 18:56:51.644686 31763 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:51.644758 31763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:51.644922 31763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:51.646006 31763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "3cb96815e696434ea2214a3a1e2e8feb"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "bd43b0068a47d4136eb2a817fbf1664e"
server_key_iv: "c2488b3eba47fabe8045a7514913904f"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.646389 31763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "3cb96815e696434ea2214a3a1e2e8feb"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "bd43b0068a47d4136eb2a817fbf1664e"
server_key_iv: "c2488b3eba47fabe8045a7514913904f"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.647697 31763 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:51.648423 31780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.648629 31763 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:51.648730 31763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "3cb96815e696434ea2214a3a1e2e8feb"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "bd43b0068a47d4136eb2a817fbf1664e"
server_key_iv: "c2488b3eba47fabe8045a7514913904f"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.648820 31763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:51.652185 31763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:51.652573 31763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:51.652743 31763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:51.652976 31763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:51.653345 31763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:51.653381 31763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.653402 31763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:51.653446 31763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.659118 31763 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:36753
I20260809 18:56:51.659219 31947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:36753 every 8 connection(s)
I20260809 18:56:51.659504 31763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:51.662500 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.660264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:50281 (local address 127.23.229.62:32917)
0809 18:56:51.660339 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.660341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.660612 (+ 271us) server_negotiation.cc:407] Connection header received
0809 18:56:51.661094 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.661095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.661100 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.661164 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.662310 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.662311 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.662311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.662317 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.662332 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.662337 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.662387 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.662432 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.662446 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:56:51.662752 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.660248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:32917 (local address 127.23.229.2:50281)
0809 18:56:51.660464 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.660531 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.661003 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.661216 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.661219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.661227 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.662151 (+ 924us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.662151 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.662181 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.662213 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.662384 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.662387 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.662389 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.662440 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.662489 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":118,"threads_started":1}
I20260809 18:56:51.662822 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 31763
I20260809 18:56:51.662961 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:51.663184 24468 external_mini_cluster.cc:1428] Setting key 97699a2ca06dfe394498823dd1db4c64
I20260809 18:56:51.663252 31948 heartbeater.cc:347] Connected to a master server at 127.23.229.62:32917
I20260809 18:56:51.663352 31948 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:51.663532 31948 heartbeater.cc:511] Master 127.23.229.62:32917 requested a full tablet report, sending...
I20260809 18:56:51.664034 31476 ts_manager.cc:194] Registered new tserver with Master: 3cb96815e696434ea2214a3a1e2e8feb (127.23.229.2:36753)
I20260809 18:56:51.664219 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:32917
--builtin_ntp_servers=127.23.229.20:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:51.749222 31957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:51.749470 31957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:51.749509 31957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:51.750698 31957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:51.750765 31957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:51.750831 31957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:51.752378 31957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:32917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:51.752713 31957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:51.753068 31957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:56:51.758558 31957 server_base.cc:1034] running on GCE node
W20260809 18:56:51.758507 31965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.758525 31962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.758497 31963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:51.758970 31957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:51.759230 31957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:51.760401 31957 hybrid_clock.cc:648] HybridClock initialized: now 1786301811760393 us; error 40 us; skew 500 ppm
I20260809 18:56:51.761783 31957 webserver.cc:460] Webserver started at http://127.23.229.3:42231/ using document root <none> and password file <none>
I20260809 18:56:51.762065 31957 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:51.762140 31957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:51.762298 31957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:51.763406 31957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "fd2c27121eb042a6994ad4e00e06093d"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "106bc5416b64fa02b2ff5023079b3d9f"
server_key_iv: "640acafaac5422a38985ec05060a14db"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.763777 31957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "fd2c27121eb042a6994ad4e00e06093d"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "106bc5416b64fa02b2ff5023079b3d9f"
server_key_iv: "640acafaac5422a38985ec05060a14db"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.765237 31957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:51.765973 31973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.766156 31957 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:51.766266 31957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "fd2c27121eb042a6994ad4e00e06093d"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-jq4t"
server_key: "106bc5416b64fa02b2ff5023079b3d9f"
server_key_iv: "640acafaac5422a38985ec05060a14db"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.766342 31957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:51.770037 31957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:51.770316 31957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:51.770460 31957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:51.770670 31957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:51.770999 31957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:51.771066 31957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.771128 31957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:51.771157 31957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.776782 31957 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:39119
I20260809 18:56:51.776856 32162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:39119 every 8 connection(s)
I20260809 18:56:51.777189 31957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:51.779863 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 31957
I20260809 18:56:51.779973 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:51.780194 24468 external_mini_cluster.cc:1428] Setting key 3a41ef6b414ed02898d57a092db117b5
I20260809 18:56:51.780458 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.777954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:41301 (local address 127.23.229.62:32917)
0809 18:56:51.778026 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.778029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.778254 (+ 225us) server_negotiation.cc:407] Connection header received
0809 18:56:51.778709 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.778710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.778715 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.778779 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.780117 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.780119 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.780119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.780124 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.780139 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.780143 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.780187 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.780343 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.780371 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:56:51.780719 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.777930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:32917 (local address 127.23.229.3:41301)
0809 18:56:51.778121 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.778161 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.778626 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.778839 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.778842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.778851 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.779910 (+ 1059us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.779910 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.779957 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.780009 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.780211 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.780218 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.780221 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.780312 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.780382 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260809 18:56:51.781121 32163 heartbeater.cc:347] Connected to a master server at 127.23.229.62:32917
I20260809 18:56:51.781235 32163 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:51.781397 32163 heartbeater.cc:511] Master 127.23.229.62:32917 requested a full tablet report, sending...
I20260809 18:56:51.781803 31476 ts_manager.cc:194] Registered new tserver with Master: fd2c27121eb042a6994ad4e00e06093d (127.23.229.3:39119)
I20260809 18:56:51.792246 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:56:51.794831 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.793783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52124 (local address 127.23.229.62:32917)
0809 18:56:51.793868 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.793870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.793934 (+ 64us) server_negotiation.cc:407] Connection header received
0809 18:56:51.793988 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.793988 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.793994 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.794042 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.794602 (+ 560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.794603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.794603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.794607 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.794621 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.794625 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.794667 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.794704 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.794715 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:56:51.796413 31476 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:51.798115 31476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:51.802191 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.800303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:33109 (local address 127.0.0.1:48630)
0809 18:56:51.800580 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.800625 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.800688 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.800958 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.800966 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.800974 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.801630 (+ 656us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.801630 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.801647 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.801672 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.802058 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.802059 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.802060 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.802090 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.802105 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":58,"threads_started":1}
I20260809 18:56:51.802242 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.800595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56450 (local address 127.23.229.3:39119)
0809 18:56:51.800794 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.800800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.800811 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:51.800839 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.800841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.800851 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.800958 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.801852 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.801863 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.801864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.801869 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.801905 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.801935 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.802006 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.802139 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.802157 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":94,"threads_started":1}
I20260809 18:56:51.802531 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.800401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48630 (local address 127.23.229.1:33109)
0809 18:56:51.800818 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.800823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.800831 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:51.800854 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.800856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.800863 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.801019 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.801879 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.801887 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.801887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.801891 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.801923 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.801961 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.802410 (+ 449us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.802435 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.802451 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":138,"threads_started":1}
I20260809 18:56:51.802541 32182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.800594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49452 (local address 127.23.229.2:36753)
0809 18:56:51.800794 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.800800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.801458 (+ 658us) server_negotiation.cc:407] Connection header received
0809 18:56:51.801492 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.801495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.801505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.801611 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.802184 (+ 573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.802193 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.802193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.802197 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.802230 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.802262 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.802323 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.802447 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.802470 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":93,"threads_started":1}
I20260809 18:56:51.802675 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.800325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:36753 (local address 127.0.0.1:49452)
0809 18:56:51.801356 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.801366 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.801423 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.801626 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.801627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.801629 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.802053 (+ 424us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.802053 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.802059 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.802070 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.802353 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.802354 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.802355 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.802400 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.802412 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1013,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260809 18:56:51.802192 32176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.800325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:39119 (local address 127.0.0.1:56450)
0809 18:56:51.800644 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.800654 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.800693 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.800967 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.800968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.800976 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.801777 (+ 801us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.801777 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.801782 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.801791 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.802023 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.802031 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.802034 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.802106 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.802116 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":92,"threads_started":1}
I20260809 18:56:51.803253 31660 tablet_service.cc:1467] Processing CreateTablet for tablet dc2ca565e678446cbd64eafbdf3fdf7d (DEFAULT_TABLE table=test-table [id=598248a69c774aa29a9376ef5ff01432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:51.803571 31660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2ca565e678446cbd64eafbdf3fdf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.803486 32051 tablet_service.cc:1467] Processing CreateTablet for tablet dc2ca565e678446cbd64eafbdf3fdf7d (DEFAULT_TABLE table=test-table [id=598248a69c774aa29a9376ef5ff01432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:51.803428 31850 tablet_service.cc:1467] Processing CreateTablet for tablet dc2ca565e678446cbd64eafbdf3fdf7d (DEFAULT_TABLE table=test-table [id=598248a69c774aa29a9376ef5ff01432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:51.803799 32051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2ca565e678446cbd64eafbdf3fdf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.803799 31850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2ca565e678446cbd64eafbdf3fdf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.806106 32183 tablet_bootstrap.cc:492] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b: Bootstrap starting.
I20260809 18:56:51.806725 32183 tablet_bootstrap.cc:654] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.807025 32183 log.cc:824] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.807053 32186 tablet_bootstrap.cc:492] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Bootstrap starting.
I20260809 18:56:51.807657 32186 tablet_bootstrap.cc:654] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.807863 32183 tablet_bootstrap.cc:492] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b: No bootstrap required, opened a new log
I20260809 18:56:51.807940 32183 ts_tablet_manager.cc:1397] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:51.807996 32186 log.cc:824] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.808343 32184 tablet_bootstrap.cc:492] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Bootstrap starting.
I20260809 18:56:51.809022 32184 tablet_bootstrap.cc:654] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.809334 32184 log.cc:824] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.809880 32186 tablet_bootstrap.cc:492] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: No bootstrap required, opened a new log
I20260809 18:56:51.809971 32186 ts_tablet_manager.cc:1397] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 18:56:51.810788 32183 raft_consensus.cc:348] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.810987 32183 raft_consensus.cc:374] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.811028 32183 raft_consensus.cc:729] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25304d6355f4163a809354d3389118b, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.811152 32183 consensus_queue.cc:260] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.811425 32183 ts_tablet_manager.cc:1428] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 18:56:51.811483 31760 heartbeater.cc:503] Master 127.23.229.62:32917 was elected leader, sending a full tablet report...
I20260809 18:56:51.812695 32186 raft_consensus.cc:348] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.812860 32186 raft_consensus.cc:374] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.812919 32186 raft_consensus.cc:729] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb96815e696434ea2214a3a1e2e8feb, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.813061 32186 consensus_queue.cc:260] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.813323 32186 ts_tablet_manager.cc:1428] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 18:56:51.813397 31948 heartbeater.cc:503] Master 127.23.229.62:32917 was elected leader, sending a full tablet report...
I20260809 18:56:51.813719 32184 tablet_bootstrap.cc:492] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: No bootstrap required, opened a new log
I20260809 18:56:51.813807 32184 ts_tablet_manager.cc:1397] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260809 18:56:51.815701 32184 raft_consensus.cc:348] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.815883 32184 raft_consensus.cc:374] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.815936 32184 raft_consensus.cc:729] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd2c27121eb042a6994ad4e00e06093d, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.816092 32184 consensus_queue.cc:260] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.816345 32184 ts_tablet_manager.cc:1428] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:56:51.816417 32163 heartbeater.cc:503] Master 127.23.229.62:32917 was elected leader, sending a full tablet report...
W20260809 18:56:51.910136 31953 tablet.cc:2369] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:51.942950 32194 raft_consensus.cc:482] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:51.943125 32194 raft_consensus.cc:504] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.943646 32194 leader_election.cc:288] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd2c27121eb042a6994ad4e00e06093d (127.23.229.3:39119), 3cb96815e696434ea2214a3a1e2e8feb (127.23.229.2:36753)
I20260809 18:56:51.945241 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.943907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:60533 (local address 127.23.229.3:39119)
0809 18:56:51.944124 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.944126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.944137 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:51.944172 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.944173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.944181 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.944243 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.944948 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.944950 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.944950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.944954 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.944972 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.944977 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.945035 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.945132 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.945148 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181}
I20260809 18:56:51.945243 31762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.943853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:39119 (local address 127.23.229.1:60533)
0809 18:56:51.943917 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.943929 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.943974 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.944271 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.944273 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.944277 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.944819 (+ 542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.944820 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.944830 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.944848 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.945061 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.945062 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.945063 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.945132 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.945150 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 18:56:51.945772 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.943888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:36753 (local address 127.23.229.1:59067)
0809 18:56:51.944454 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.944466 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.944552 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.944691 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.944691 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.944694 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:51.945391 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:51.945392 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:51.945399 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:51.945413 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:51.945618 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:51.945618 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:51.945620 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:56:51.945676 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 18:56:51.945691 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":101,"threads_started":1}
I20260809 18:56:51.945782 32182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.944125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:59067 (local address 127.23.229.2:36753)
0809 18:56:51.944181 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.944184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.944546 (+ 362us) server_negotiation.cc:407] Connection header received
0809 18:56:51.944611 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.944613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.944619 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.944673 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.945511 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.945512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.945512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.945517 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.945535 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.945539 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.945602 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.945673 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.945687 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 18:56:51.946336 31880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2ca565e678446cbd64eafbdf3fdf7d" candidate_uuid: "b25304d6355f4163a809354d3389118b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb96815e696434ea2214a3a1e2e8feb" is_pre_election: true
I20260809 18:56:51.946543 31880 raft_consensus.cc:2454] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25304d6355f4163a809354d3389118b in term 0.
I20260809 18:56:51.946848 31595 leader_election.cc:302] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb96815e696434ea2214a3a1e2e8feb, b25304d6355f4163a809354d3389118b; no voters:
I20260809 18:56:51.947042 32194 raft_consensus.cc:2781] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:51.947167 32194 raft_consensus.cc:482] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:51.947197 32194 raft_consensus.cc:3037] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.948591 32194 raft_consensus.cc:504] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.948772 32194 leader_election.cc:288] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [CANDIDATE]: Term 1 election: Requested vote from peers fd2c27121eb042a6994ad4e00e06093d (127.23.229.3:39119), 3cb96815e696434ea2214a3a1e2e8feb (127.23.229.2:36753)
I20260809 18:56:51.950155 32084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2ca565e678446cbd64eafbdf3fdf7d" candidate_uuid: "b25304d6355f4163a809354d3389118b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd2c27121eb042a6994ad4e00e06093d" is_pre_election: true
I20260809 18:56:51.950223 31880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2ca565e678446cbd64eafbdf3fdf7d" candidate_uuid: "b25304d6355f4163a809354d3389118b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb96815e696434ea2214a3a1e2e8feb"
I20260809 18:56:51.950302 31880 raft_consensus.cc:3037] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.950337 32084 raft_consensus.cc:2454] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25304d6355f4163a809354d3389118b in term 0.
I20260809 18:56:51.950183 32082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2ca565e678446cbd64eafbdf3fdf7d" candidate_uuid: "b25304d6355f4163a809354d3389118b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd2c27121eb042a6994ad4e00e06093d"
I20260809 18:56:51.950527 32082 raft_consensus.cc:3037] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.951355 31880 raft_consensus.cc:2454] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25304d6355f4163a809354d3389118b in term 1.
I20260809 18:56:51.951472 32082 raft_consensus.cc:2454] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25304d6355f4163a809354d3389118b in term 1.
I20260809 18:56:51.951614 31595 leader_election.cc:302] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb96815e696434ea2214a3a1e2e8feb, b25304d6355f4163a809354d3389118b; no voters:
I20260809 18:56:51.951728 32194 raft_consensus.cc:2781] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:51.951936 32194 raft_consensus.cc:686] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 1 LEADER]: Becoming Leader. State: Replica: b25304d6355f4163a809354d3389118b, State: Running, Role: LEADER
I20260809 18:56:51.952068 32194 consensus_queue.cc:237] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } }
I20260809 18:56:51.953222 31476 catalog_manager.cc:5495] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b reported cstate change: term changed from 0 to 1, leader changed from <none> to b25304d6355f4163a809354d3389118b (127.23.229.1). New cstate: current_term: 1 leader_uuid: "b25304d6355f4163a809354d3389118b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25304d6355f4163a809354d3389118b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:51.992451 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.991058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48646 (local address 127.23.229.1:33109)
0809 18:56:51.991114 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.991117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.991168 (+ 51us) server_negotiation.cc:407] Connection header received
0809 18:56:51.991280 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.991281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.991312 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.991388 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.992189 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.992192 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.992192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.992196 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.992216 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.992220 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.992284 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.992346 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.992362 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:56:51.994740 31880 raft_consensus.cc:1261] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 1 FOLLOWER]: Refusing update from remote peer b25304d6355f4163a809354d3389118b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:51.994766 32082 raft_consensus.cc:1261] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 1 FOLLOWER]: Refusing update from remote peer b25304d6355f4163a809354d3389118b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:51.995146 32201 consensus_queue.cc:1035] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb96815e696434ea2214a3a1e2e8feb" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:51.995306 32194 consensus_queue.cc:1035] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd2c27121eb042a6994ad4e00e06093d" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:51.998217 32211 mvcc.cc:205] Tried to move back new op lower bound from 7316692221927276544 to 7316692221756661760. Current Snapshot: MvccSnapshot[applied={T|T < 7316692221927276544}]
I20260809 18:56:52.000029 31476 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:52.000156 31476 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:52.001005 31476 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0db272b01c104238aab9335c14586d32: Sending DeleteTablet for 3 replicas of tablet dc2ca565e678446cbd64eafbdf3fdf7d
I20260809 18:56:52.001379 32051 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2ca565e678446cbd64eafbdf3fdf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:51 UTC) from {username='slave'} at 127.0.0.1:56450
I20260809 18:56:52.001425 31850 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2ca565e678446cbd64eafbdf3fdf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:51 UTC) from {username='slave'} at 127.0.0.1:49452
I20260809 18:56:52.001507 31660 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2ca565e678446cbd64eafbdf3fdf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:51 UTC) from {username='slave'} at 127.0.0.1:48630
I20260809 18:56:52.001662 32223 tablet_replica.cc:330] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: stopping tablet replica
I20260809 18:56:52.001778 32223 raft_consensus.cc:2229] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:52.001801 32225 tablet_replica.cc:330] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b: stopping tablet replica
I20260809 18:56:52.001905 32223 raft_consensus.cc:2258] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:52.001906 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 31574
I20260809 18:56:52.002051 32225 raft_consensus.cc:2229] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:52.002352 32225 raft_consensus.cc:2258] T dc2ca565e678446cbd64eafbdf3fdf7d P b25304d6355f4163a809354d3389118b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:52.002889 32223 ts_tablet_manager.cc:1905] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:52.005221 32223 ts_tablet_manager.cc:1918] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:52.005302 32223 log.cc:1196] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/dc2ca565e678446cbd64eafbdf3fdf7d
I20260809 18:56:52.005527 32223 ts_tablet_manager.cc:1939] T dc2ca565e678446cbd64eafbdf3fdf7d P fd2c27121eb042a6994ad4e00e06093d: Deleting consensus metadata
I20260809 18:56:52.006209 31455 catalog_manager.cc:4841] TS fd2c27121eb042a6994ad4e00e06093d (127.23.229.3:39119): tablet dc2ca565e678446cbd64eafbdf3fdf7d (table test-table [id=598248a69c774aa29a9376ef5ff01432]) successfully deleted
I20260809 18:56:52.010005 32224 tablet_replica.cc:330] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: stopping tablet replica
I20260809 18:56:52.010228 32224 raft_consensus.cc:2229] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:52.010411 32224 raft_consensus.cc:2258] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:52.012923 32224 ts_tablet_manager.cc:1905] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:52.014971 32224 ts_tablet_manager.cc:1918] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:52.015079 32224 log.cc:1196] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/dc2ca565e678446cbd64eafbdf3fdf7d
I20260809 18:56:52.015355 32224 ts_tablet_manager.cc:1939] T dc2ca565e678446cbd64eafbdf3fdf7d P 3cb96815e696434ea2214a3a1e2e8feb: Deleting consensus metadata
I20260809 18:56:52.015856 31451 catalog_manager.cc:4841] TS 3cb96815e696434ea2214a3a1e2e8feb (127.23.229.2:36753): tablet dc2ca565e678446cbd64eafbdf3fdf7d (table test-table [id=598248a69c774aa29a9376ef5ff01432]) successfully deleted
W20260809 18:56:52.017889 31446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:33109 (error 108)
I20260809 18:56:52.018446 32176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.018278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:33109 (local address 127.0.0.1:48648)
0809 18:56:52.018354 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:52.018408 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:33109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 18:56:52.018464 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 31763
W20260809 18:56:52.023772 31446 catalog_manager.cc:4584] TS b25304d6355f4163a809354d3389118b (127.23.229.1:33109): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dc2ca565e678446cbd64eafbdf3fdf7d: Network error: Client connection negotiation failed: client connection to 127.23.229.1:33109: connect: Connection refused (error 111)
I20260809 18:56:52.042189 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 31957
I20260809 18:56:52.052671 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 31420
2026-08-09T18:56:52Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (845 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 18:56:52.081282 24468 mini_oidc.cc:152] Starting JWKS server
I20260809 18:56:52.082439 24468 webserver.cc:460] Webserver started at https://127.0.0.1:39655/ using document root <none> and password file <none>
I20260809 18:56:52.082561 24468 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:56:52.082739 24468 webserver.cc:460] Webserver started at http://127.0.0.1:38539/ using document root <none> and password file <none>
2026-08-09T18:56:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:52Z Disabled control of system clock
I20260809 18:56:52.091697 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40363
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:32981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:40363
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39655/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/testchainca.cert with env {}
W20260809 18:56:52.177608 32235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:52.177876 32235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:52.177906 32235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:52.179323 32235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:52.179380 32235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:52.179394 32235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:52.179407 32235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:52.179419 32235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:52.179432 32235 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:52.179443 32235 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39655/jwks.json
I20260809 18:56:52.181269 32235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:32981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:40363
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39655/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:52.181576 32235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:52.181835 32235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:52.187186 32245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:52.187254 32235 server_base.cc:1034] running on GCE node
W20260809 18:56:52.187178 32247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:52.187184 32249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:52.187796 32235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:52.188069 32235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:52.189234 32235 hybrid_clock.cc:648] HybridClock initialized: now 1786301812189208 us; error 49 us; skew 500 ppm
I20260809 18:56:52.190573 32235 webserver.cc:460] Webserver started at http://127.23.229.62:38267/ using document root <none> and password file <none>
I20260809 18:56:52.190846 32235 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:52.190898 32235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:52.191063 32235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:52.192169 32235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "856d4b6c5cd24c9199a511da43d47afb"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "d8ab8cc6317d4f888ab734e3f5a94d5c"
server_key_iv: "e6a700fc3fda12956a05375b5924bf19"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.192608 32235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "856d4b6c5cd24c9199a511da43d47afb"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "d8ab8cc6317d4f888ab734e3f5a94d5c"
server_key_iv: "e6a700fc3fda12956a05375b5924bf19"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.194085 32235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:52.194932 32262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:52.195122 32235 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:52.195236 32235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "856d4b6c5cd24c9199a511da43d47afb"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "d8ab8cc6317d4f888ab734e3f5a94d5c"
server_key_iv: "e6a700fc3fda12956a05375b5924bf19"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.195333 32235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:52.215657 32235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:52.216045 32235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:52.216221 32235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:52.220744 32235 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:40363
I20260809 18:56:52.220784 32347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:40363 every 8 connection(s)
I20260809 18:56:52.221184 32235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:52.222254 32348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:52.225049 32348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb: Bootstrap starting.
I20260809 18:56:52.225744 32348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:52.226104 32348 log.cc:824] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:52.226797 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 32235
I20260809 18:56:52.226933 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:52.227089 32348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb: No bootstrap required, opened a new log
I20260809 18:56:52.227144 24468 external_mini_cluster.cc:1428] Setting key f281a6ec1b5765a2a09d1ec9df836776
I20260809 18:56:52.229396 32348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856d4b6c5cd24c9199a511da43d47afb" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40363 } }
I20260809 18:56:52.229559 32348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:52.229584 32348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 856d4b6c5cd24c9199a511da43d47afb, State: Initialized, Role: FOLLOWER
I20260809 18:56:52.229737 32348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856d4b6c5cd24c9199a511da43d47afb" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40363 } }
I20260809 18:56:52.229820 32348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:52.229867 32348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:52.229924 32348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:52.230613 32348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856d4b6c5cd24c9199a511da43d47afb" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40363 } }
I20260809 18:56:52.230746 32348 leader_election.cc:302] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 856d4b6c5cd24c9199a511da43d47afb; no voters:
I20260809 18:56:52.230997 32348 leader_election.cc:288] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:52.231029 32356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:52.231165 32356 raft_consensus.cc:686] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [term 1 LEADER]: Becoming Leader. State: Replica: 856d4b6c5cd24c9199a511da43d47afb, State: Running, Role: LEADER
I20260809 18:56:52.231264 32356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856d4b6c5cd24c9199a511da43d47afb" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40363 } }
I20260809 18:56:52.231338 32348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:52.231655 32356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 856d4b6c5cd24c9199a511da43d47afb. Latest consensus state: current_term: 1 leader_uuid: "856d4b6c5cd24c9199a511da43d47afb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856d4b6c5cd24c9199a511da43d47afb" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40363 } } }
I20260809 18:56:52.231741 32356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.231667 32357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "856d4b6c5cd24c9199a511da43d47afb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856d4b6c5cd24c9199a511da43d47afb" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40363 } } }
I20260809 18:56:52.231932 32357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.232137 32371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:52.233052 32371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:52.234480 32355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.227736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50012 (local address 127.23.229.62:40363)
0809 18:56:52.228013 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.228020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.228057 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:56:52.228602 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.228610 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.228695 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.228850 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:52.229110 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.230529 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.231686 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.232360 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.232472 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.233614 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:52.233618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:52.233618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:52.233849 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:52.233892 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:52.233906 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:52.233961 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:52.234123 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 18:56:52.234219 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":115,"threads_started":1}
I20260809 18:56:52.235090 32371 catalog_manager.cc:1347] Generated new cluster ID: 1c8dea9413a444df9b3fcc02631cb4a9
I20260809 18:56:52.235147 32371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:52.235597 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:52.260360 32371 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:52.261003 32371 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:52.265450 32371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 856d4b6c5cd24c9199a511da43d47afb: Generated new TSK 0
I20260809 18:56:52.265686 32371 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 18:56:52.290351 32399 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 18:56:52.290504 32399 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260809 18:56:52.291169 32398 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:52.274195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40363 (local address 127.0.0.1:50018)
0809 18:56:52.274410 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:52.274421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:52.274485 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:52.274687 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:52.274688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:52.274689 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:52.274748 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.274749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.275865 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.275866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.276466 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.276467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.277055 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.277056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.277105 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.277126 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:52.290621 (+ 13495us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 18:56:52.290739 (+ 118us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.229.62:40363: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":115,"threads_started":1}
I20260809 18:56:52.291554 32355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.274309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50018 (local address 127.23.229.62:40363)
0809 18:56:52.274374 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.274376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.274497 (+ 121us) server_negotiation.cc:407] Connection header received
0809 18:56:52.274576 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.274577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.274592 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.274687 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:52.274829 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.275770 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.276595 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.276947 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.277033 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.277257 (+ 224us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:52.290435 (+ 13178us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 18:56:52.291482 (+ 1047us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50018: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":29}
W20260809 18:56:52.291635 32355 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50018: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.23.229.62:40363: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 18:56:52.291749 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 32235
2026-08-09T18:56:52Z chronyd exiting
I20260809 18:56:52.336215 24468 test_util.cc:175] -----------------------------------------------
I20260809 18:56:52.336340 24468 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301787754163-24468-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (256 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 18:56:52.337229 24468 mini_oidc.cc:152] Starting JWKS server
I20260809 18:56:52.337972 24468 webserver.cc:460] Webserver started at https://127.0.0.1:40669/ using document root <none> and password file <none>
I20260809 18:56:52.338044 24468 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:56:52.338220 24468 webserver.cc:460] Webserver started at http://127.0.0.1:39769/ using document root <none> and password file <none>
2026-08-09T18:56:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:52Z Disabled control of system clock
I20260809 18:56:52.347252 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43361
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:40477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43361
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40669/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/testchainca.cert with env {}
W20260809 18:56:52.433748 32408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:52.434028 32408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:52.434073 32408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:52.435297 32408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:52.435384 32408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:52.435405 32408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:52.435425 32408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:52.435453 32408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:52.435483 32408 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:52.435506 32408 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40669/jwks.json
I20260809 18:56:52.437163 32408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:40477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43361
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40669/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:52.437480 32408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:52.437716 32408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:52.443059 32418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:52.443063 32417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:52.443037 32421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:52.443380 32408 server_base.cc:1034] running on GCE node
I20260809 18:56:52.443667 32408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:52.443982 32408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:52.445163 32408 hybrid_clock.cc:648] HybridClock initialized: now 1786301812445154 us; error 37 us; skew 500 ppm
I20260809 18:56:52.446521 32408 webserver.cc:460] Webserver started at http://127.23.229.62:37789/ using document root <none> and password file <none>
I20260809 18:56:52.446786 32408 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:52.446904 32408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:52.447062 32408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:52.448199 32408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "5fad4804a3e149fcb23f305c9c51b840"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "5630d9415842e9e9be272d527f48235e"
server_key_iv: "cbb8bc26d19bebb33dd7016148f8fe3d"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.448663 32408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "5fad4804a3e149fcb23f305c9c51b840"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "5630d9415842e9e9be272d527f48235e"
server_key_iv: "cbb8bc26d19bebb33dd7016148f8fe3d"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.450083 32408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:52.450865 32434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:52.451052 32408 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:52.451161 32408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "5fad4804a3e149fcb23f305c9c51b840"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "5630d9415842e9e9be272d527f48235e"
server_key_iv: "cbb8bc26d19bebb33dd7016148f8fe3d"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.451251 32408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:52.472503 32408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:52.472893 32408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:52.473074 32408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:52.477396 32408 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43361
I20260809 18:56:52.477434 32509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43361 every 8 connection(s)
I20260809 18:56:52.477813 32408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:52.478554 32510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:52.481675 32510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840: Bootstrap starting.
I20260809 18:56:52.482240 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 32408
I20260809 18:56:52.482369 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:52.482457 32510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:52.482617 24468 external_mini_cluster.cc:1428] Setting key 7c1af36b7268c3c3940d077855620974
I20260809 18:56:52.482854 32510 log.cc:824] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:52.483737 32510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840: No bootstrap required, opened a new log
I20260809 18:56:52.486016 32510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad4804a3e149fcb23f305c9c51b840" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43361 } }
I20260809 18:56:52.486207 32510 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:52.486238 32510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fad4804a3e149fcb23f305c9c51b840, State: Initialized, Role: FOLLOWER
I20260809 18:56:52.486358 32510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad4804a3e149fcb23f305c9c51b840" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43361 } }
I20260809 18:56:52.486428 32510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:52.486459 32510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:52.486507 32510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:52.487151 32510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad4804a3e149fcb23f305c9c51b840" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43361 } }
I20260809 18:56:52.487275 32510 leader_election.cc:302] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fad4804a3e149fcb23f305c9c51b840; no voters:
I20260809 18:56:52.487454 32510 leader_election.cc:288] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:52.487612 32520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:52.487777 32510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:52.488124 32520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [term 1 LEADER]: Becoming Leader. State: Replica: 5fad4804a3e149fcb23f305c9c51b840, State: Running, Role: LEADER
I20260809 18:56:52.488283 32520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad4804a3e149fcb23f305c9c51b840" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43361 } }
I20260809 18:56:52.488950 32519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.483199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37062 (local address 127.23.229.62:43361)
0809 18:56:52.483443 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.483453 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.483495 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:56:52.484044 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.484052 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.484115 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.484236 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:52.484514 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.485447 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.486586 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.487025 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.487117 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.487932 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:52.487937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:52.487937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:52.488192 (+ 255us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:52.488238 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:52.488253 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:52.488328 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:52.488571 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 18:56:52.488668 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":84,"threads_started":1}
I20260809 18:56:52.488998 32522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fad4804a3e149fcb23f305c9c51b840" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad4804a3e149fcb23f305c9c51b840" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43361 } } }
I20260809 18:56:52.489094 32522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.489333 32523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fad4804a3e149fcb23f305c9c51b840. Latest consensus state: current_term: 1 leader_uuid: "5fad4804a3e149fcb23f305c9c51b840" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad4804a3e149fcb23f305c9c51b840" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43361 } } }
I20260809 18:56:52.489403 32523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.489537 32535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:52.490103 32535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:52.490136 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:52.493616 32535 catalog_manager.cc:1347] Generated new cluster ID: 9c7b84e8ec2245c6a5bada8227eccda3
I20260809 18:56:52.493664 32535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:52.500643 32535 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:52.501363 32535 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:52.508383 32535 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5fad4804a3e149fcb23f305c9c51b840: Generated new TSK 0
I20260809 18:56:52.508651 32535 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 18:56:52.536988 32560 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 18:56:52.537104 32560 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 18:56:52.537480 32519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.522663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37076 (local address 127.23.229.62:43361)
0809 18:56:52.522718 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.522720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.522769 (+ 49us) server_negotiation.cc:407] Connection header received
0809 18:56:52.522867 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.522868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.522880 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.522949 (+ 69us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:52.523126 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.523651 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.524862 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.525085 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.525146 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.525350 (+ 204us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:52.537266 (+ 11916us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 18:56:52.537413 (+ 147us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37076: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 18:56:52.537561 32519 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37076: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 18:56:52.537698 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:52.522514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43361 (local address 127.0.0.1:37076)
0809 18:56:52.522700 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:52.522713 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:52.522791 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:52.522968 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:52.522969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:52.522971 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:52.523057 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.523059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.523733 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.523734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.524773 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.524777 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.525171 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.525172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.525241 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.525247 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:52.537412 (+ 12165us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 18:56:52.537587 (+ 175us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.229.62:43361: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":110,"threads_started":1}
I20260809 18:56:52.538084 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 32408
2026-08-09T18:56:52Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (253 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 18:56:52.591084 24468 mini_oidc.cc:152] Starting JWKS server
I20260809 18:56:52.591871 24468 webserver.cc:460] Webserver started at https://127.0.0.1:34289/ using document root <none> and password file <none>
I20260809 18:56:52.591950 24468 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:56:52.592141 24468 webserver.cc:460] Webserver started at http://127.0.0.1:45755/ using document root <none> and password file <none>
2026-08-09T18:56:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:52Z Disabled control of system clock
I20260809 18:56:52.601478 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42361
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:45585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42361
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34289/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 18:56:52.686672 32571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:52.686882 32571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:52.686904 32571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:52.687990 32571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:52.688024 32571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:52.688037 32571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:52.688050 32571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:52.688062 32571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:52.688076 32571 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:52.688086 32571 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34289/jwks.json
I20260809 18:56:52.689532 32571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42361
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34289/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:52.689746 32571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:52.689990 32571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:52.695044 32577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:52.695091 32578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:52.695200 32571 server_base.cc:1034] running on GCE node
W20260809 18:56:52.695047 32582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:52.695559 32571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:52.695911 32571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:52.697059 32571 hybrid_clock.cc:648] HybridClock initialized: now 1786301812697038 us; error 42 us; skew 500 ppm
I20260809 18:56:52.698460 32571 webserver.cc:460] Webserver started at http://127.23.229.62:34665/ using document root <none> and password file <none>
I20260809 18:56:52.698732 32571 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:52.698786 32571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:52.698920 32571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:52.700008 32571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "efed7698e0aa4beaa656a6c4277cb534"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "a4624a90a4ec5326cf80a1bd011a6daa"
server_key_iv: "5d757583c43d8ec7e39930ec9d22193e"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.700366 32571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "efed7698e0aa4beaa656a6c4277cb534"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "a4624a90a4ec5326cf80a1bd011a6daa"
server_key_iv: "5d757583c43d8ec7e39930ec9d22193e"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.701745 32571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:52.702517 32588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:52.702730 32571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:52.702828 32571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "efed7698e0aa4beaa656a6c4277cb534"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "a4624a90a4ec5326cf80a1bd011a6daa"
server_key_iv: "5d757583c43d8ec7e39930ec9d22193e"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.702885 32571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:52.711185 32571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:52.711444 32571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:52.711551 32571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:52.715838 32571 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:42361
I20260809 18:56:52.715909 32669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:42361 every 8 connection(s)
I20260809 18:56:52.716337 32571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:52.717124 32672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:52.719971 32672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534: Bootstrap starting.
I20260809 18:56:52.720674 32672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:52.720993 32672 log.cc:824] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:52.721724 32672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534: No bootstrap required, opened a new log
I20260809 18:56:52.723349 32672 raft_consensus.cc:348] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efed7698e0aa4beaa656a6c4277cb534" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42361 } }
I20260809 18:56:52.723520 32672 raft_consensus.cc:374] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:52.723573 32672 raft_consensus.cc:729] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efed7698e0aa4beaa656a6c4277cb534, State: Initialized, Role: FOLLOWER
I20260809 18:56:52.723732 32672 consensus_queue.cc:260] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efed7698e0aa4beaa656a6c4277cb534" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42361 } }
I20260809 18:56:52.723821 32672 raft_consensus.cc:388] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:52.723866 32672 raft_consensus.cc:482] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:52.723918 32672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:52.724571 32672 raft_consensus.cc:504] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efed7698e0aa4beaa656a6c4277cb534" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42361 } }
I20260809 18:56:52.724689 32672 leader_election.cc:302] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efed7698e0aa4beaa656a6c4277cb534; no voters:
I20260809 18:56:52.724891 32672 leader_election.cc:288] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:52.724938 32677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:52.725142 32677 raft_consensus.cc:686] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [term 1 LEADER]: Becoming Leader. State: Replica: efed7698e0aa4beaa656a6c4277cb534, State: Running, Role: LEADER
I20260809 18:56:52.725184 32672 sys_catalog.cc:564] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:52.725241 32677 consensus_queue.cc:237] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efed7698e0aa4beaa656a6c4277cb534" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42361 } }
I20260809 18:56:52.725672 32680 sys_catalog.cc:455] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [sys.catalog]: SysCatalogTable state changed. Reason: New leader efed7698e0aa4beaa656a6c4277cb534. Latest consensus state: current_term: 1 leader_uuid: "efed7698e0aa4beaa656a6c4277cb534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efed7698e0aa4beaa656a6c4277cb534" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42361 } } }
I20260809 18:56:52.725828 32680 sys_catalog.cc:458] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.725868 32679 sys_catalog.cc:455] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efed7698e0aa4beaa656a6c4277cb534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efed7698e0aa4beaa656a6c4277cb534" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42361 } } }
I20260809 18:56:52.725961 32679 sys_catalog.cc:458] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.726209 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 32571
I20260809 18:56:52.726318 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:52.726514 24468 external_mini_cluster.cc:1428] Setting key 8e4860ba8ec6790ce5aa8b972b304780
W20260809 18:56:52.727123 32697 catalog_manager.cc:1558] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:56:52.727193 32697 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:52.727280 32698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:52.727483 32698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:52.729077 32698 catalog_manager.cc:1347] Generated new cluster ID: 2c923f5fef94442ab597a466764e8242
I20260809 18:56:52.729139 32698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:52.732321 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.727135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.23.229.62:42361)
0809 18:56:52.727565 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.727573 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.727602 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:56:52.727724 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.727731 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.727801 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.727943 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:52.728236 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.729471 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.730277 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.730722 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.730882 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.731634 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:52.731638 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:52.731638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:52.731824 (+ 186us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:52.731858 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:52.731869 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:52.731950 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:52.732027 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 18:56:52.732109 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":80,"threads_started":1}
I20260809 18:56:52.733261 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:52.738709 32698 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:52.739415 32698 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:52.743841 32698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P efed7698e0aa4beaa656a6c4277cb534: Generated new TSK 0
I20260809 18:56:52.744035 32698 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:52.760056 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.755919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60350 (local address 127.23.229.62:42361)
0809 18:56:52.755976 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.755979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.756132 (+ 153us) server_negotiation.cc:407] Connection header received
0809 18:56:52.756171 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.756172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.756185 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.756256 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:52.756392 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.757276 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.758462 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.758685 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.758745 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.758949 (+ 204us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:52.759809 (+ 860us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34289/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 18:56:52.759968 (+ 159us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60350: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34289/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":28}
W20260809 18:56:52.760120 32706 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60350: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34289/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 18:56:52.760141 32715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:52.755833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42361 (local address 127.0.0.1:60350)
0809 18:56:52.756015 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:52.756026 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:52.756092 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:52.756261 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:52.756262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:52.756264 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:52.756317 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.756319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.757383 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.757385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.758370 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.758373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.758780 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.758781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.758846 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.758852 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:52.759931 (+ 1079us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34289/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 18:56:52.760037 (+ 106us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.229.62:42361: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34289/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":110,"threads_started":1}
I20260809 18:56:52.760550 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 32571
E20260809 18:56:52.788666 32720 webserver.cc:533] Webserver: sslize failed:
E20260809 18:56:52.788764 32720 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T18:56:52Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (226 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T18:56:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:52Z Disabled control of system clock
I20260809 18:56:52.826251 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:36789
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:42003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:36789
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/testchainca.cert with env {}
W20260809 18:56:52.911794 32726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:52.912017 32726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:52.912042 32726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:52.913208 32726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:52.913246 32726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:52.913259 32726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:52.913272 32726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:52.913283 32726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:52.913296 32726 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:52.913307 32726 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 18:56:52.914790 32726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:36789
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:36789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:52.914999 32726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:52.915165 32726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:52.920280 32735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:52.920308 32736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:52.920327 32738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:52.920696 32726 server_base.cc:1034] running on GCE node
I20260809 18:56:52.920989 32726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:52.921321 32726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:52.922504 32726 hybrid_clock.cc:648] HybridClock initialized: now 1786301812922495 us; error 39 us; skew 500 ppm
I20260809 18:56:52.923887 32726 webserver.cc:460] Webserver started at http://127.23.229.62:35307/ using document root <none> and password file <none>
I20260809 18:56:52.924168 32726 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:52.924242 32726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:52.924397 32726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:52.925580 32726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "23c24c74be5541769872dbf690bc3d0a"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "c38e4da4bc0950660b0e69c641e04845"
server_key_iv: "6ef95be3c7ee35a9697dae3b3080e112"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.925971 32726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "23c24c74be5541769872dbf690bc3d0a"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "c38e4da4bc0950660b0e69c641e04845"
server_key_iv: "6ef95be3c7ee35a9697dae3b3080e112"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.927312 32726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:56:52.928046 32749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:52.928226 32726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:52.928320 32726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "23c24c74be5541769872dbf690bc3d0a"
format_stamp: "Formatted at 2026-08-09 18:56:52 on dist-test-slave-jq4t"
server_key: "c38e4da4bc0950660b0e69c641e04845"
server_key_iv: "6ef95be3c7ee35a9697dae3b3080e112"
server_key_version: "encryptionkey@0"
I20260809 18:56:52.928408 32726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:52.939850 32726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:52.940127 32726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:52.940230 32726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:52.944366 32726 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:36789
I20260809 18:56:52.944406 369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:36789 every 8 connection(s)
I20260809 18:56:52.944835 32726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:52.945890 373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:52.948362 373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a: Bootstrap starting.
I20260809 18:56:52.949036 373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:52.949357 373 log.cc:824] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:52.950122 373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a: No bootstrap required, opened a new log
I20260809 18:56:52.951455 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 32726
I20260809 18:56:52.951567 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:52.951758 24468 external_mini_cluster.cc:1428] Setting key e9a4678e96237a4c212443ec6bca626f
I20260809 18:56:52.952370 373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c24c74be5541769872dbf690bc3d0a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36789 } }
I20260809 18:56:52.952622 373 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:52.952677 373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23c24c74be5541769872dbf690bc3d0a, State: Initialized, Role: FOLLOWER
I20260809 18:56:52.952812 373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c24c74be5541769872dbf690bc3d0a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36789 } }
I20260809 18:56:52.952913 373 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:52.952957 373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:52.953007 373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:52.953591 373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c24c74be5541769872dbf690bc3d0a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36789 } }
I20260809 18:56:52.953717 373 leader_election.cc:302] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23c24c74be5541769872dbf690bc3d0a; no voters:
I20260809 18:56:52.953924 373 leader_election.cc:288] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:52.953948 386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:52.954075 386 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [term 1 LEADER]: Becoming Leader. State: Replica: 23c24c74be5541769872dbf690bc3d0a, State: Running, Role: LEADER
I20260809 18:56:52.954164 386 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c24c74be5541769872dbf690bc3d0a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36789 } }
I20260809 18:56:52.954228 373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:52.954517 388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23c24c74be5541769872dbf690bc3d0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c24c74be5541769872dbf690bc3d0a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36789 } } }
I20260809 18:56:52.954517 389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23c24c74be5541769872dbf690bc3d0a. Latest consensus state: current_term: 1 leader_uuid: "23c24c74be5541769872dbf690bc3d0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c24c74be5541769872dbf690bc3d0a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36789 } } }
I20260809 18:56:52.954674 388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.954696 389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:52.955124 401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:52.955684 401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:52.957792 401 catalog_manager.cc:1347] Generated new cluster ID: e3053b6f5483495aa77a64572d4c77b9
I20260809 18:56:52.957851 401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:52.958597 379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.952353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59482 (local address 127.23.229.62:36789)
0809 18:56:52.952589 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.952597 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.952624 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:56:52.952768 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.952775 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.952845 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.953011 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:52.953244 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.954883 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.956070 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.956722 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.956854 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.957876 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:52.957879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:52.957880 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:52.958075 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:52.958110 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:52.958121 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:52.958203 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:52.958287 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 18:56:52.958374 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":99,"threads_started":1}
I20260809 18:56:52.959564 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:52.980512 401 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:52.981102 401 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:52.984025 401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23c24c74be5541769872dbf690bc3d0a: Generated new TSK 0
I20260809 18:56:52.984241 401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:53.048725 379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:52.991401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.23.229.62:36789)
0809 18:56:52.991455 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:52.991457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:52.991551 (+ 94us) server_negotiation.cc:407] Connection header received
0809 18:56:52.991638 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:52.991639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:52.991651 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:52.991720 (+ 69us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:52.991909 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.992441 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.993676 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.993896 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.993972 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.994219 (+ 247us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:53.048360 (+ 54141us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 18:56:53.048639 (+ 279us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59488: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":28}
W20260809 18:56:53.048820 379 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59488: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 18:56:53.048789 419 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:52.991263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:36789 (local address 127.0.0.1:59488)
0809 18:56:52.991462 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:52.991475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:52.991558 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:52.991748 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:52.991749 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:52.991751 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:52.991823 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.991826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.992583 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.992584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.993568 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:52.993572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:52.994006 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:52.994008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:52.994071 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:52.994078 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:53.048576 (+ 54498us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 18:56:53.048708 (+ 132us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.229.62:36789: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":105,"threads_started":1}
I20260809 18:56:53.049229 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 32726
2026-08-09T18:56:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (257 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (93 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (94 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:53 dist-test-slave-jq4t krb5kdc[441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:53 dist-test-slave-jq4t krb5kdc[441](info): set up 2 sockets
Aug 09 18:56:53 dist-test-slave-jq4t krb5kdc[441](info): commencing operation
krb5kdc: starting...
W20260809 18:56:54.499624 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:54 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:56:54.628425 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40565
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:40565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:54.715093 459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:54.715379 459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:54.715423 459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:54.716698 459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:54.716775 459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:54.716799 459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:54.716830 459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:54.716877 459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:54.718483 459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:40565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:54.718780 459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:54.719028 459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:54.724346 467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:54.724396 466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:54.724367 470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:54.724594 459 server_base.cc:1034] running on GCE node
I20260809 18:56:54.724866 459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:54.725217 459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:54.726387 459 hybrid_clock.cc:648] HybridClock initialized: now 1786301814726363 us; error 43 us; skew 500 ppm
Aug 09 18:56:54 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:54.729192 459 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:56:54.729700 459 webserver.cc:460] Webserver started at http://127.23.229.62:37509/ using document root <none> and password file <none>
I20260809 18:56:54.729947 459 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:54.730018 459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:54.730181 459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:54.731310 459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "4e3240d783fb4a7a8f4006efc2b9aa22"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-jq4t"
server_key: "2a17c52b652fc7ee0ba05320d503d88a"
server_key_iv: "ea5bd0370fe00d4619c04b8b60fdbf5b"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.731688 459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "4e3240d783fb4a7a8f4006efc2b9aa22"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-jq4t"
server_key: "2a17c52b652fc7ee0ba05320d503d88a"
server_key_iv: "ea5bd0370fe00d4619c04b8b60fdbf5b"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.733211 459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:54.734112 486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:54.734297 459 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:54.734408 459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "4e3240d783fb4a7a8f4006efc2b9aa22"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-jq4t"
server_key: "2a17c52b652fc7ee0ba05320d503d88a"
server_key_iv: "ea5bd0370fe00d4619c04b8b60fdbf5b"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.734491 459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:54.745594 459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:54.748031 459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:54.748204 459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:54.752733 459 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:40565
I20260809 18:56:54.752820 565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:40565 every 8 connection(s)
I20260809 18:56:54.753219 459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:54.754300 569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:54.754439 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 459
I20260809 18:56:54.754571 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:54.754787 24468 external_mini_cluster.cc:1428] Setting key 003def014f05edc4218a790aff29f2a0
I20260809 18:56:54.758210 569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22: Bootstrap starting.
I20260809 18:56:54.759063 569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:54.759420 569 log.cc:824] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:54.760351 569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22: No bootstrap required, opened a new log
Aug 09 18:56:54 dist-test-slave-jq4t krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:54.762844 569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40565 } }
I20260809 18:56:54.763082 569 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:54.763134 569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3240d783fb4a7a8f4006efc2b9aa22, State: Initialized, Role: FOLLOWER
I20260809 18:56:54.763301 569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40565 } }
I20260809 18:56:54.763410 569 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:54.763446 569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:54.763496 569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:54.764382 569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40565 } }
I20260809 18:56:54.764524 569 leader_election.cc:302] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e3240d783fb4a7a8f4006efc2b9aa22; no voters:
I20260809 18:56:54.764734 569 leader_election.cc:288] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:54.764812 575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:54.764986 575 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3240d783fb4a7a8f4006efc2b9aa22, State: Running, Role: LEADER
I20260809 18:56:54.765062 569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:54.765125 575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40565 } }
I20260809 18:56:54.765457 576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40565 } } }
I20260809 18:56:54.765568 576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:54.765784 577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e3240d783fb4a7a8f4006efc2b9aa22. Latest consensus state: current_term: 1 leader_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e3240d783fb4a7a8f4006efc2b9aa22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40565 } } }
I20260809 18:56:54.766153 583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:54.766167 577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:54.767127 583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:54.767380 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:54.755430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49280 (local address 127.23.229.62:40565)
0809 18:56:54.755628 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:54.755646 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:54.755674 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:56:54.756132 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:54.756140 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:54.756191 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:54.756315 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:54.757276 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.758204 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.759344 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.759813 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.759908 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:54.762519 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:54.762524 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:54.762524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:54.762539 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:54.764904 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:54.765385 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:54.765388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:54.765388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:54.765499 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:54.765758 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:54.765759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:54.765760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:54.766112 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:54.766928 (+ 816us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:54.767006 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:56:54.767172 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260809 18:56:54.768989 583 catalog_manager.cc:1347] Generated new cluster ID: 5cc88e4f9c1b48bb86f9a73b27b7e9c7
I20260809 18:56:54.769047 583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:54.793309 583 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:54.794158 583 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:54.803371 583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e3240d783fb4a7a8f4006efc2b9aa22: Generated new TSK 0
I20260809 18:56:54.803673 583 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:56:54.847908 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40565
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:54.949908 616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:54.950127 616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:54.950151 616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:54.951363 616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:54.951409 616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:54.951437 616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:54.953061 616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:54.953347 616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:54.953609 616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:54.959065 621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:54.959074 624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:54.959110 616 server_base.cc:1034] running on GCE node
W20260809 18:56:54.959102 627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:54.959609 616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:54.959877 616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:54.961042 616 hybrid_clock.cc:648] HybridClock initialized: now 1786301814961031 us; error 32 us; skew 500 ppm
Aug 09 18:56:54 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:54.963711 616 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:56:54.964135 616 webserver.cc:460] Webserver started at http://127.23.229.1:44753/ using document root <none> and password file <none>
I20260809 18:56:54.964403 616 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:54.964458 616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:54.964658 616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:54.965854 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "9daf6c72ea9b4d72a76b958a847e8a21"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-jq4t"
server_key: "9ded496d86399ba06cabbd910c44626c"
server_key_iv: "14fc996941c84cb2493aeb1e610a23cc"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.966261 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "9daf6c72ea9b4d72a76b958a847e8a21"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-jq4t"
server_key: "9ded496d86399ba06cabbd910c44626c"
server_key_iv: "14fc996941c84cb2493aeb1e610a23cc"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.967705 616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:54.968564 636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:54.968736 616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:54.968843 616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "9daf6c72ea9b4d72a76b958a847e8a21"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-jq4t"
server_key: "9ded496d86399ba06cabbd910c44626c"
server_key_iv: "14fc996941c84cb2493aeb1e610a23cc"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.968930 616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:54.982719 616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:54.985469 616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:54.985649 616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:54.985913 616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:54.986274 616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:54.986332 616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:54.986380 616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:54.986409 616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:54.992981 616 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:34323
I20260809 18:56:54.993070 810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:34323 every 8 connection(s)
I20260809 18:56:54.993489 616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:54.995231 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 616
I20260809 18:56:54.995360 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:54.995628 24468 external_mini_cluster.cc:1428] Setting key b7c76347ac13b18a468197bb266e4846
Aug 09 18:56:54 dist-test-slave-jq4t krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:55.005683 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:54.994494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:60749 (local address 127.23.229.62:40565)
0809 18:56:54.994590 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:54.994592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:54.994727 (+ 135us) server_negotiation.cc:407] Connection header received
0809 18:56:54.996241 (+ 1514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:54.996242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:54.996257 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:54.996338 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:54.997323 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.997847 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.999282 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.999542 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.999642 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.002288 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.002290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.002291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.002301 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.004052 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.004506 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.004508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.004509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.004583 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.004844 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.004845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.004846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.005031 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.005122 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.005465 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.005579 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:56:55.005791 818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:54.994404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40565 (local address 127.23.229.1:60749)
0809 18:56:54.994587 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:54.994630 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:54.996013 (+ 1383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:54.996428 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:54.996432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:54.996883 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:54.997200 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:54.997208 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.997958 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.997959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:54.999171 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:54.999174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.999660 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.999661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:54.999804 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.000395 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:55.000406 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:55.002169 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:55.004146 (+ 1977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.004154 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.004157 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.004395 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.004657 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.004657 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.004658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.004772 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.005144 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:55.005152 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:55.005307 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 18:56:55.005416 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 18:56:55.005564 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260809 18:56:55.006439 811 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40565
I20260809 18:56:55.006564 811 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:55.006785 811 heartbeater.cc:511] Master 127.23.229.62:40565 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 18:56:55.007423 511 ts_manager.cc:194] Registered new tserver with Master: 9daf6c72ea9b4d72a76b958a847e8a21 (127.23.229.1:34323)
I20260809 18:56:55.008176 511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:60749
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:56:55.027803 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40565
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:55.114116 822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:55.114324 822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:55.114356 822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:55.115473 822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:55.115507 822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:55.115532 822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:55.117005 822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:55.117202 822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:55.117398 822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:55.122742 833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.122745 832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.122750 837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:55.123095 822 server_base.cc:1034] running on GCE node
I20260809 18:56:55.123342 822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:55.123615 822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:55.124784 822 hybrid_clock.cc:648] HybridClock initialized: now 1786301815124761 us; error 39 us; skew 500 ppm
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.127437 822 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:56:55.127933 822 webserver.cc:460] Webserver started at http://127.23.229.2:46001/ using document root <none> and password file <none>
I20260809 18:56:55.128198 822 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:55.128270 822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:55.128423 822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:55.129513 822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "c0b0cf581b9c429881c3c210456e2810"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-jq4t"
server_key: "f4f7d8f6af1528dc8a2bcaaee58fc297"
server_key_iv: "476e6c66a87e5a06e6f8139949c180dd"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.129876 822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "c0b0cf581b9c429881c3c210456e2810"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-jq4t"
server_key: "f4f7d8f6af1528dc8a2bcaaee58fc297"
server_key_iv: "476e6c66a87e5a06e6f8139949c180dd"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.131263 822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:56:55.131999 847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.132175 822 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:55.132283 822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "c0b0cf581b9c429881c3c210456e2810"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-jq4t"
server_key: "f4f7d8f6af1528dc8a2bcaaee58fc297"
server_key_iv: "476e6c66a87e5a06e6f8139949c180dd"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.132359 822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:55.163424 822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:55.165789 822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:55.165968 822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:55.166265 822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:55.166620 822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:55.166677 822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.166716 822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:55.166749 822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.172571 822 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:46097
I20260809 18:56:55.172618 1028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:46097 every 8 connection(s)
I20260809 18:56:55.172969 822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:55.174372 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 822
I20260809 18:56:55.174481 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:55.174714 24468 external_mini_cluster.cc:1428] Setting key deddf2dc853f02f6a001e084cfa5e8bd
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:55.184103 1034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.173728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40565 (local address 127.23.229.2:42391)
0809 18:56:55.173892 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:55.173936 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:55.175276 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:55.175566 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:55.175571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:55.175983 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:55.176279 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.176286 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.177041 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.177042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.178024 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.178026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.178536 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.178537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.178689 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.179212 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:55.179223 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:55.180842 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:55.182741 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.182747 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.182749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.182968 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.183197 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.183197 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.183198 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.183297 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.183602 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:55.183607 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:55.183724 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 18:56:55.183807 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:56:55.183930 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260809 18:56:55.184091 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.173760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:42391 (local address 127.23.229.62:40565)
0809 18:56:55.173811 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.173813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.174034 (+ 221us) server_negotiation.cc:407] Connection header received
0809 18:56:55.175387 (+ 1353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.175389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.175402 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.175465 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.176379 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.176948 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.178121 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.178438 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.178524 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.180941 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.180943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.180943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.180959 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.182650 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.183047 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.183049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.183049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.183123 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.183365 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.183366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.183367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.183531 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.183608 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.183861 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.183988 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:56:55.184731 1030 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40565
I20260809 18:56:55.184857 1030 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:55.185060 1030 heartbeater.cc:511] Master 127.23.229.62:40565 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
I20260809 18:56:55.185526 511 ts_manager.cc:194] Registered new tserver with Master: c0b0cf581b9c429881c3c210456e2810 (127.23.229.2:46097)
I20260809 18:56:55.185933 511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:42391
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:56:55.203251 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40565
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:55.288930 1038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:55.289150 1038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:55.289173 1038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:55.290287 1038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:55.290324 1038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:55.290349 1038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:55.291817 1038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:55.292027 1038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:55.292207 1038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:55.297281 1043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.297266 1046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.297266 1050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:55.297600 1038 server_base.cc:1034] running on GCE node
I20260809 18:56:55.297864 1038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:55.298118 1038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:55.299299 1038 hybrid_clock.cc:648] HybridClock initialized: now 1786301815299289 us; error 31 us; skew 500 ppm
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.302083 1038 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:56:55.302497 1038 webserver.cc:460] Webserver started at http://127.23.229.3:38391/ using document root <none> and password file <none>
I20260809 18:56:55.302696 1038 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:55.302738 1038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:55.302911 1038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:55.304098 1038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "964ed315a6864cc3ab31cecd179faf58"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-jq4t"
server_key: "6ef95752c271d674ecaed3985d2592e7"
server_key_iv: "c8d1cf7ebafe87d6d73812fd418a9d0c"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.304425 1038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "964ed315a6864cc3ab31cecd179faf58"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-jq4t"
server_key: "6ef95752c271d674ecaed3985d2592e7"
server_key_iv: "c8d1cf7ebafe87d6d73812fd418a9d0c"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.305847 1038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:55.306559 1060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.306720 1038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:55.306806 1038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "964ed315a6864cc3ab31cecd179faf58"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-jq4t"
server_key: "6ef95752c271d674ecaed3985d2592e7"
server_key_iv: "c8d1cf7ebafe87d6d73812fd418a9d0c"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.306865 1038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:55.343978 1038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:55.346259 1038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:55.346385 1038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:55.346594 1038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:55.346964 1038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:55.347010 1038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.347033 1038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:55.347081 1038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.353041 1038 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:36643
I20260809 18:56:55.353118 1231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:36643 every 8 connection(s)
I20260809 18:56:55.353497 1038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:55.359575 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 1038
I20260809 18:56:55.359688 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:55.359876 24468 external_mini_cluster.cc:1428] Setting key 44d37d78e85bfc5ec684f9b2770fb8cd
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:56:55.363340 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.354282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:51511 (local address 127.23.229.62:40565)
0809 18:56:55.354370 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.354373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.354547 (+ 174us) server_negotiation.cc:407] Connection header received
0809 18:56:55.355530 (+ 983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.355531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.355546 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.355620 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.356275 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.356875 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.357871 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.358078 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.358136 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.360828 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.360829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.360830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.360839 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.362124 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.362504 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.362505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.362505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.362558 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.362773 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.362773 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.362774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.362880 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.362931 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.363203 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.363273 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 18:56:55.363497 1235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.354224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40565 (local address 127.23.229.3:51511)
0809 18:56:55.354393 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:55.354432 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:55.355422 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:55.355695 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:55.355699 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:55.355970 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:55.356187 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.356191 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.356956 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.356956 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.357784 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.357785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.358183 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.358184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.358304 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.358953 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:55.358962 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:55.360732 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:55.362196 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.362202 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.362205 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.362437 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.362616 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.362616 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.362617 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.362719 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.362935 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:55.362940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:55.363062 (+ 122us) client_negotiation.cc:769] Sending connection context
0809 18:56:55.363164 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 18:56:55.363292 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":102,"threads_started":1}
I20260809 18:56:55.364012 1232 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40565
I20260809 18:56:55.364096 1232 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:55.364244 1232 heartbeater.cc:511] Master 127.23.229.62:40565 requested a full tablet report, sending...
I20260809 18:56:55.364607 511 ts_manager.cc:194] Registered new tserver with Master: 964ed315a6864cc3ab31cecd179faf58 (127.23.229.3:36643)
I20260809 18:56:55.365044 511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:51511
I20260809 18:56:55.371856 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/test-admin.keytab.
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.390111 24468 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 18:56:55.392117 1244 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:55.391261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45074 (local address 127.23.229.1:34323)
0809 18:56:55.391447 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.391452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.391461 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:55.391490 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.391492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.391513 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.391596 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.392026 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45074: BlockingRecv error: recv got EOF from 127.0.0.1:45074 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":82,"threads_started":1}
W20260809 18:56:55.392256 24468 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5cc' of type FILE
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.393361 24468 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.394313 24468 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:55.402565 1244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.394887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.23.229.1:34323)
0809 18:56:55.394938 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.394940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.395010 (+ 70us) server_negotiation.cc:407] Connection header received
0809 18:56:55.395056 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.395057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.395067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.395109 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.395533 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.396286 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.397100 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.397455 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.397521 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.399689 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.399699 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.399700 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.399707 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.401568 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.401891 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.401894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.401895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.401949 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.402112 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.402113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.402113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.402253 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.402365 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.402422 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.402487 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260809 18:56:55.404563 1244 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:55.404007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.23.229.1:34323)
0809 18:56:55.404071 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.404072 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.404093 (+ 21us) server_negotiation.cc:407] Connection header received
0809 18:56:55.404142 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.404143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.404153 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.404194 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.404459 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45096: BlockingRecv error: recv got EOF from 127.0.0.1:45096 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 18:56:55.404619 24468 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5cc' of type FILE
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.405604 24468 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.406445 24468 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:55.413601 1244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.406963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45106 (local address 127.23.229.1:34323)
0809 18:56:55.407022 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.407023 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.407100 (+ 77us) server_negotiation.cc:407] Connection header received
0809 18:56:55.407118 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.407118 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.407126 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.407164 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.407498 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.407988 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.408708 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.408931 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.408993 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.411189 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.411190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.411191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.411197 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.412673 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.412962 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.412963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.412963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.413017 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.413134 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.413135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.413135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.413220 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.413287 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.413377 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.413434 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 18:56:55.415091 1244 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:55.414632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45110 (local address 127.23.229.1:34323)
0809 18:56:55.414664 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.414666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.414700 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:56:55.414757 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.414758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.414765 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.414802 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.415044 (+ 242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45110: BlockingRecv error: recv got EOF from 127.0.0.1:45110 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260809 18:56:55.415258 24468 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301787754163-24468-0/krb5kdc/krb5cc' of type FILE
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.416193 24468 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.417047 24468 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:56:55.423565 1244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.417665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45124 (local address 127.23.229.1:34323)
0809 18:56:55.417716 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.417718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.417756 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:56:55.417804 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.417805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.417812 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.417857 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.418194 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.418658 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.419297 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.419473 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.419527 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.421433 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.421435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.421435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.421441 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.422652 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.422944 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.422946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.422946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.422996 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.423154 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.423154 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.423155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.423239 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.423305 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.423408 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.423470 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:56:55.424255 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 616
I20260809 18:56:55.435761 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 822
I20260809 18:56:55.446969 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 1038
I20260809 18:56:55.459419 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 459
2026-08-09T18:56:55Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2227 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[1266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[1266](info): set up 2 sockets
Aug 09 18:56:55 dist-test-slave-jq4t krb5kdc[1266](info): commencing operation
krb5kdc: starting...
W20260809 18:56:56.716980 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:56:56 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab.
Entry for principal oryx/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab.
I20260809 18:56:56.843173 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:37999
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab
--principal=oryx/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:37999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:56.928994 1286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:56.929221 1286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:56.929247 1286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:56.930449 1286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:56.930498 1286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:56.930513 1286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:56.930526 1286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:56.930539 1286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:56.932148 1286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:37999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab
--principal=oryx/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:37999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:56.932441 1286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:56.932716 1286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:56:56.937997 1286 server_base.cc:1034] running on GCE node
W20260809 18:56:56.937877 1298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:56.937891 1295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:56.937875 1303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:56.938405 1286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:56.938689 1286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:56.939836 1286 hybrid_clock.cc:648] HybridClock initialized: now 1786301816939815 us; error 42 us; skew 500 ppm
Aug 09 18:56:56 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.946506 1286 init.cc:377] Logged in from keytab as oryx/127.23.229.62@KRBTEST.COM (short username oryx)
I20260809 18:56:56.947033 1286 webserver.cc:460] Webserver started at http://127.23.229.62:43681/ using document root <none> and password file <none>
I20260809 18:56:56.947299 1286 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:56.947371 1286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:56.947521 1286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:56.948704 1286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "2f28714a43be4261a929bfa3fa746b0b"
format_stamp: "Formatted at 2026-08-09 18:56:56 on dist-test-slave-jq4t"
server_key: "a5785a3bca2506e6ba17e758961732f9"
server_key_iv: "7fcd5c8edff10040b3f27ffc6266b020"
server_key_version: "encryptionkey@0"
I20260809 18:56:56.949082 1286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "2f28714a43be4261a929bfa3fa746b0b"
format_stamp: "Formatted at 2026-08-09 18:56:56 on dist-test-slave-jq4t"
server_key: "a5785a3bca2506e6ba17e758961732f9"
server_key_iv: "7fcd5c8edff10040b3f27ffc6266b020"
server_key_version: "encryptionkey@0"
I20260809 18:56:56.950455 1286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:56.951218 1320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:56.951432 1286 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:56.951550 1286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "2f28714a43be4261a929bfa3fa746b0b"
format_stamp: "Formatted at 2026-08-09 18:56:56 on dist-test-slave-jq4t"
server_key: "a5785a3bca2506e6ba17e758961732f9"
server_key_iv: "7fcd5c8edff10040b3f27ffc6266b020"
server_key_version: "encryptionkey@0"
I20260809 18:56:56.951632 1286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:56.979589 1286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:56.982199 1286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:56.982378 1286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:56.986848 1286 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:37999
I20260809 18:56:56.986899 1404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:37999 every 8 connection(s)
I20260809 18:56:56.987289 1286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:56.988319 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:56.988850 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 1286
I20260809 18:56:56.988965 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:56:56.989195 24468 external_mini_cluster.cc:1428] Setting key 8f527011e00f2ccc903dcd72bc3d18d3
I20260809 18:56:56.991746 1405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: Bootstrap starting.
I20260809 18:56:56.992424 1405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:56.992803 1405 log.cc:824] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:56.993584 1405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: No bootstrap required, opened a new log
Aug 09 18:56:56 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:56.996248 1405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } }
I20260809 18:56:56.996445 1405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:56.996537 1405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f28714a43be4261a929bfa3fa746b0b, State: Initialized, Role: FOLLOWER
I20260809 18:56:56.996688 1405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } }
I20260809 18:56:56.996770 1405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:56.996794 1405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:56.996873 1405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:56.997646 1405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } }
I20260809 18:56:56.997741 1405 leader_election.cc:302] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f28714a43be4261a929bfa3fa746b0b; no voters:
I20260809 18:56:56.997960 1405 leader_election.cc:288] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:56.997983 1415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:56.998111 1415 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 1 LEADER]: Becoming Leader. State: Replica: 2f28714a43be4261a929bfa3fa746b0b, State: Running, Role: LEADER
I20260809 18:56:56.998199 1415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } }
I20260809 18:56:56.998292 1405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:56.998556 1416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } }
I20260809 18:56:56.998653 1416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:56.999995 1417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f28714a43be4261a929bfa3fa746b0b. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } }
I20260809 18:56:57.000066 1417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
W20260809 18:56:57.000322 1439 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:56:57.000376 1439 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:57.000599 1441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:57.000787 1441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:57.001502 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.989786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33982 (local address 127.23.229.62:37999)
0809 18:56:56.989988 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.990004 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.990034 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:56:56.990436 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.990443 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.990499 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.990612 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.991425 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.992408 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.993434 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.993892 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.993987 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.996932 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.996937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.996937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.996952 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.999622 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.000066 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.000069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.000069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.000179 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.000384 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.000385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.000385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.000762 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.000918 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.001091 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.001234 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":96,"threads_started":1}
I20260809 18:56:57.002411 1441 catalog_manager.cc:1347] Generated new cluster ID: 2625554564554dc1b8f2725e1ac39bad
I20260809 18:56:57.002473 1441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:57.013891 1441 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:57.014456 1441 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:57.019503 1441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: Generated new TSK 0
I20260809 18:56:57.019727 1441 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab.
Entry for principal oryx/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab.
I20260809 18:56:57.056929 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:37999
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab
--principal=oryx/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:57.144682 1454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:57.144904 1454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:57.144932 1454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:57.146180 1454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:57.146236 1454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:57.146296 1454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:57.147881 1454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab
--principal=oryx/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:37999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:57.148149 1454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:57.148430 1454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:57.153846 1461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.153837 1464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.153837 1459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:57.154037 1454 server_base.cc:1034] running on GCE node
I20260809 18:56:57.154289 1454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:57.154507 1454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:57.155653 1454 hybrid_clock.cc:648] HybridClock initialized: now 1786301817155629 us; error 41 us; skew 500 ppm
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:57.158435 1454 init.cc:377] Logged in from keytab as oryx/127.23.229.1@KRBTEST.COM (short username oryx)
I20260809 18:56:57.158878 1454 webserver.cc:460] Webserver started at http://127.23.229.1:35157/ using document root <none> and password file <none>
I20260809 18:56:57.159152 1454 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:57.159224 1454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:57.159379 1454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:57.160557 1454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "fbbd68703549461ebc2dc5bbedcee8a1"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "9ae3e2b50bb3ef6482938e603a858577"
server_key_iv: "322b86c3c2d70c78060d4a4df0811076"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.160959 1454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "fbbd68703549461ebc2dc5bbedcee8a1"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "9ae3e2b50bb3ef6482938e603a858577"
server_key_iv: "322b86c3c2d70c78060d4a4df0811076"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.162431 1454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:56:57.163349 1477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.163525 1454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:57.163635 1454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "fbbd68703549461ebc2dc5bbedcee8a1"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "9ae3e2b50bb3ef6482938e603a858577"
server_key_iv: "322b86c3c2d70c78060d4a4df0811076"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.163725 1454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:57.180859 1454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:57.183517 1454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:57.183704 1454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:57.183993 1454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:57.184348 1454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:57.184406 1454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.184449 1454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:57.184502 1454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.190412 1454 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:42237
I20260809 18:56:57.190490 1656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:42237 every 8 connection(s)
I20260809 18:56:57.190863 1454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:57.193225 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 1454
I20260809 18:56:57.193360 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:57.193583 24468 external_mini_cluster.cc:1428] Setting key b0c9c89f2199c54ea8b9a44a10afaf5d
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:57.202000 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.191732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:46493 (local address 127.23.229.62:37999)
0809 18:56:57.191804 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.191806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.192032 (+ 226us) server_negotiation.cc:407] Connection header received
0809 18:56:57.192659 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.192660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.192674 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.192734 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.193922 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.194464 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.195532 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.195775 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.195861 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.198241 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.198243 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.198243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.198252 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.200289 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.200811 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.200813 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.200814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.200886 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.201214 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.201215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.201215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.201378 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.201453 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.201750 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.201869 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:56:57.202021 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.191694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:46493)
0809 18:56:57.191900 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.191939 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.192538 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.192809 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.192813 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.193533 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.193836 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.193843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.194576 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.194577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.195432 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.195435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.195873 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.195874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.196018 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.196622 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.196631 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.198124 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.200396 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.200404 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.200406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.200726 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.200988 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.200990 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.200990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.201122 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.201450 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.201455 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.201599 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.201683 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.201824 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
I20260809 18:56:57.202935 1658 heartbeater.cc:347] Connected to a master server at 127.23.229.62:37999
I20260809 18:56:57.203037 1658 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:57.203253 1658 heartbeater.cc:511] Master 127.23.229.62:37999 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 18:56:57.203878 1349 ts_manager.cc:194] Registered new tserver with Master: fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237)
I20260809 18:56:57.204666 1349 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:46493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab.
Entry for principal oryx/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab.
I20260809 18:56:57.223361 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:37999
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab
--principal=oryx/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:57.310482 1664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:57.310709 1664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:57.310735 1664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:57.311877 1664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:57.311919 1664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:57.311945 1664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:57.313460 1664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab
--principal=oryx/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:37999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:57.313674 1664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:57.313863 1664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:57.319038 1676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.319072 1675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.319051 1679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:57.319253 1664 server_base.cc:1034] running on GCE node
I20260809 18:56:57.319566 1664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:57.319880 1664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:57.321059 1664 hybrid_clock.cc:648] HybridClock initialized: now 1786301817321057 us; error 43 us; skew 500 ppm
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:57.323863 1664 init.cc:377] Logged in from keytab as oryx/127.23.229.2@KRBTEST.COM (short username oryx)
I20260809 18:56:57.324360 1664 webserver.cc:460] Webserver started at http://127.23.229.2:46413/ using document root <none> and password file <none>
I20260809 18:56:57.324666 1664 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:57.324740 1664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:57.324908 1664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:57.326045 1664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "88d96d0c6573489282a0da1e316caa74"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3b62fdf8940a68a9ffee39d435a13dcf"
server_key_iv: "1b22c9a535efcd700cd3d9b1f6b0129f"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.326478 1664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "88d96d0c6573489282a0da1e316caa74"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3b62fdf8940a68a9ffee39d435a13dcf"
server_key_iv: "1b22c9a535efcd700cd3d9b1f6b0129f"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.328037 1664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:57.328917 1688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.329103 1664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:56:57.329200 1664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "88d96d0c6573489282a0da1e316caa74"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3b62fdf8940a68a9ffee39d435a13dcf"
server_key_iv: "1b22c9a535efcd700cd3d9b1f6b0129f"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.329262 1664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:57.348989 1664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:57.351277 1664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:57.351399 1664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:57.351625 1664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:57.351922 1664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:57.351956 1664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.351982 1664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:57.351995 1664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.358021 1664 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:42087
I20260809 18:56:57.358098 1879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:42087 every 8 connection(s)
I20260809 18:56:57.358443 1664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:57.359546 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 1664
I20260809 18:56:57.359650 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:57.359848 24468 external_mini_cluster.cc:1428] Setting key 1148d7d2be204283d5c413fe1f8b17e5
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:57.369047 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.359240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:44861 (local address 127.23.229.62:37999)
0809 18:56:57.359310 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.359313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.359524 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:56:57.360258 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.360260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.360274 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.360351 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.361420 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.361940 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.363001 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.363332 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.363411 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.365626 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.365628 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.365629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.365637 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.367496 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.367971 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.367973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.367974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.368048 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.368298 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.368305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.368306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.368469 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.368568 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.368834 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.368934 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 18:56:57.369084 1882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.359201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:44861)
0809 18:56:57.359384 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.359429 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.360143 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.360429 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.360433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.361107 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.361315 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.361320 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.362052 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.362053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.362897 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.362899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.363429 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.363430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.363547 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.364100 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.364109 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.365523 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.367602 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.367610 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.367613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.367890 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.368128 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.368129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.368129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.368232 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.368556 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.368568 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.368693 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.368780 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.368907 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260809 18:56:57.369916 1880 heartbeater.cc:347] Connected to a master server at 127.23.229.62:37999
I20260809 18:56:57.370039 1880 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:57.370265 1880 heartbeater.cc:511] Master 127.23.229.62:37999 requested a full tablet report, sending...
I20260809 18:56:57.370705 1349 ts_manager.cc:194] Registered new tserver with Master: 88d96d0c6573489282a0da1e316caa74 (127.23.229.2:42087)
WARNING: no policy specified for oryx/127.23.229.3@KRBTEST.COM; defaulting to no policy
I20260809 18:56:57.371135 1349 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:44861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab.
Entry for principal oryx/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab.
I20260809 18:56:57.391746 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:37999
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab
--principal=oryx/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:57.478454 1885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:57.478705 1885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:57.478731 1885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:57.479964 1885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:57.480023 1885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:57.480052 1885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:57.481652 1885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab
--principal=oryx/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:37999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:57.481946 1885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:57.482211 1885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:57.487746 1890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:57.487926 1885 server_base.cc:1034] running on GCE node
W20260809 18:56:57.487746 1891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.487774 1894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:57.488274 1885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:57.488647 1885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:57.489796 1885 hybrid_clock.cc:648] HybridClock initialized: now 1786301817489778 us; error 45 us; skew 500 ppm
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:57.492435 1885 init.cc:377] Logged in from keytab as oryx/127.23.229.3@KRBTEST.COM (short username oryx)
I20260809 18:56:57.493007 1885 webserver.cc:460] Webserver started at http://127.23.229.3:36337/ using document root <none> and password file <none>
I20260809 18:56:57.493247 1885 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:57.493333 1885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:57.493495 1885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:57.494594 1885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "c8e6c689f4c34713b5d9f237b3aa89ad"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "1e2319beaad37372df946c5d405aba3c"
server_key_iv: "737226958ce41f49333cf4a9d4ee7498"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.494980 1885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "c8e6c689f4c34713b5d9f237b3aa89ad"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "1e2319beaad37372df946c5d405aba3c"
server_key_iv: "737226958ce41f49333cf4a9d4ee7498"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.496343 1885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:56:57.497166 1904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.497354 1885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:57.497478 1885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "c8e6c689f4c34713b5d9f237b3aa89ad"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "1e2319beaad37372df946c5d405aba3c"
server_key_iv: "737226958ce41f49333cf4a9d4ee7498"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.497557 1885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:57.508198 1885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:57.510305 1885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:57.510485 1885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:57.510732 1885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:57.511088 1885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:57.511148 1885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.511194 1885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:57.511219 1885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.517339 1885 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:38819
I20260809 18:56:57.517388 2080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:38819 every 8 connection(s)
I20260809 18:56:57.517737 1885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:57.527518 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.518529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:49451 (local address 127.23.229.62:37999)
0809 18:56:57.518605 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.518607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.518816 (+ 209us) server_negotiation.cc:407] Connection header received
0809 18:56:57.519430 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.519431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.519442 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.519505 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.520655 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.521174 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.522197 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.522382 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.522435 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.524825 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.524827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.524827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.524834 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.526074 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.526495 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.526495 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.526496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.526547 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.526938 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.526939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.526939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.527064 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.527123 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.527379 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.527448 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 18:56:57.527765 2083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.518483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:49451)
0809 18:56:57.518680 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.518726 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.519237 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.519617 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.519622 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.520274 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.520548 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.520555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.521265 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.521266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.522116 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.522118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.522458 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.522459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.522564 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.523170 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.523180 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.524723 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.526165 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.526171 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.526173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.526420 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.526666 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.526668 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.526668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.526831 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.527128 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.527134 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.527260 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.527349 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.527490 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260809 18:56:57.527980 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 1885
I20260809 18:56:57.528077 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:57.528292 24468 external_mini_cluster.cc:1428] Setting key 3409339480f95958f5be46776a709016
I20260809 18:56:57.528376 2081 heartbeater.cc:347] Connected to a master server at 127.23.229.62:37999
I20260809 18:56:57.528527 2081 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:57.528762 2081 heartbeater.cc:511] Master 127.23.229.62:37999 requested a full tablet report, sending...
I20260809 18:56:57.529212 1348 ts_manager.cc:194] Registered new tserver with Master: c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3:38819)
I20260809 18:56:57.529623 1348 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:49451
I20260809 18:56:57.540578 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.229.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.61.keytab.
Entry for principal oryx/127.23.229.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.61.keytab.
I20260809 18:56:57.567678 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:37757
--webserver_interface=127.23.229.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.61.keytab
--principal=oryx/127.23.229.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:37999,127.23.229.61:37757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:57.652748 2087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:57.652956 2087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:57.652978 2087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:57.654117 2087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:57.654160 2087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:57.654175 2087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:57.654187 2087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:57.654201 2087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:57.655764 2087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:37999,127.23.229.61:37757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.61.keytab
--principal=oryx/127.23.229.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:37757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.229.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
W20260809 18:56:57.655903 2087 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.23.229.62:37999,127.23.229.61:37757'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 18:56:57.656056 2087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:57.656301 2087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:57.661211 2101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.661199 2098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.661199 2096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:57.661410 2087 server_base.cc:1034] running on GCE node
I20260809 18:56:57.661686 2087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:57.661998 2087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:57.663165 2087 hybrid_clock.cc:648] HybridClock initialized: now 1786301817663159 us; error 39 us; skew 500 ppm
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:57.665807 2087 init.cc:377] Logged in from keytab as oryx/127.23.229.61@KRBTEST.COM (short username oryx)
I20260809 18:56:57.666348 2087 webserver.cc:460] Webserver started at http://127.23.229.61:42675/ using document root <none> and password file <none>
I20260809 18:56:57.666579 2087 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:57.666621 2087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:57.666720 2087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:57.667866 2087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/instance:
uuid: "e22763e4e9e84e63a134291acd8da39d"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "ff7750dfae0de1c61f5f7870282ca6f2"
server_key_iv: "441af053ac6724bf822acdd51b264220"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.668191 2087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal/instance:
uuid: "e22763e4e9e84e63a134291acd8da39d"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "ff7750dfae0de1c61f5f7870282ca6f2"
server_key_iv: "441af053ac6724bf822acdd51b264220"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.669624 2087 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:56:57.670384 2113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.670571 2087 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:56:57.670665 2087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
uuid: "e22763e4e9e84e63a134291acd8da39d"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "ff7750dfae0de1c61f5f7870282ca6f2"
server_key_iv: "441af053ac6724bf822acdd51b264220"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.670722 2087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:57.682705 2087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:57.685110 2087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:57.685228 2087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:57.689180 2087 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.61:37757
I20260809 18:56:57.689214 2210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.61:37757 every 8 connection(s)
I20260809 18:56:57.689615 2087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
I20260809 18:56:57.690730 2212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:57.692382 2212 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:56:57.693326 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 2087
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.61@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.229.61@KRBTEST.COM
I20260809 18:56:57.703197 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.693280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33984 (local address 127.23.229.62:37999)
0809 18:56:57.693344 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.693346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.693592 (+ 246us) server_negotiation.cc:407] Connection header received
0809 18:56:57.694309 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.694310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.694321 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.694370 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.695001 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.695575 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.696726 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.697035 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.697108 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.699630 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.699631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.699632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.699641 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.701401 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.701915 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.701916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.701917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.701986 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.702310 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.702311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.702311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.702555 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.702636 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.702987 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.703092 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:56:57.703399 2215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.693222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:33984)
0809 18:56:57.693447 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.693492 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.694176 (+ 684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.694421 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.694423 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.694736 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.694899 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.694903 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.695678 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.695679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.696644 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.696647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.697112 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.697113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.697248 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.697891 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.697903 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.699528 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.701510 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.701518 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.701521 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.701825 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.702069 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.702069 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.702070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.702230 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.702621 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.702624 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.702829 (+ 205us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.702951 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.703136 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":133,"threads_started":1}
I20260809 18:56:57.703397 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.693981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36002 (local address 127.23.229.61:37757)
0809 18:56:57.694156 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.694162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.694200 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:56:57.694285 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.694287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.694310 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.694424 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.695098 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.696110 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.697052 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.697504 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.697595 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.700085 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.700094 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.700094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.700102 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.702009 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.702427 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.702431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.702431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.702493 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.702706 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.702707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.702707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.702878 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.703043 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.703145 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.703210 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":98,"threads_started":1}
I20260809 18:56:57.704213 2212 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.61@KRBTEST.COM for oryx/127.23.229.61@KRBTEST.COM
I20260809 18:56:57.710556 2215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.704531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.0.0.1:36006)
0809 18:56:57.704573 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.704585 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.704630 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.704741 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.704742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.704856 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.704914 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.704915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.705524 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.705525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.705998 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.705999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.706381 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.706381 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.706438 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.706806 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.706810 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.708095 (+ 1285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.709638 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.709638 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.709639 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.709810 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.710020 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.710021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.710021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.710075 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.710276 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.710277 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.710312 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.710368 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.710451 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260809 18:56:57.710623 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.704576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36006 (local address 127.23.229.61:37757)
0809 18:56:57.704618 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.704622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.704635 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:56:57.704689 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.704690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.704699 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.704739 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.704973 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.705454 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.706099 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.706307 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.706376 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.708190 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.708192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.708192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.708198 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.709549 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.709910 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.709911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.709911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.709960 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.710124 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.710124 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.710124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.710225 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.710272 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.710386 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.710496 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":20}
I20260809 18:56:57.712071 2212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Bootstrap starting.
I20260809 18:56:57.713044 2212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:57.713294 2212 log.cc:824] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:57.714061 2212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: No bootstrap required, opened a new log
I20260809 18:56:57.715493 2212 raft_consensus.cc:348] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } }
I20260809 18:56:57.715626 2212 raft_consensus.cc:374] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:57.715703 2212 raft_consensus.cc:729] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e22763e4e9e84e63a134291acd8da39d, State: Initialized, Role: FOLLOWER
I20260809 18:56:57.715858 2212 consensus_queue.cc:260] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } }
I20260809 18:56:57.716132 2222 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } } }
I20260809 18:56:57.716220 2212 sys_catalog.cc:564] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:57.716220 2222 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:56:57.718086 2244 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:56:57.718152 2244 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:57.720023 2087 master_runner.cc:428] Detected that this master e22763e4e9e84e63a134291acd8da39d is joining an existing cluster
I20260809 18:56:57.720084 2087 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.229.61:37757
I20260809 18:56:57.728087 2258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.721192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.0.0.1:36008)
0809 18:56:57.721383 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.721392 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.721452 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.721651 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.721652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.721928 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.722004 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.722006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.722896 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.722897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.723765 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.723767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.724154 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.724155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.724233 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.724657 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.724662 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.725107 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.726836 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.726837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.726837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.727088 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.727312 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.727313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.727313 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.727365 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.727650 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.727651 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.727700 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.727798 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.727911 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":129,"threads_started":1}
I20260809 18:56:57.728098 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.721407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.23.229.61:37757)
0809 18:56:57.721449 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.721450 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.721457 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:56:57.721536 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.721537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.721548 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.721610 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.722093 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.722805 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.723848 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.724074 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.724154 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.725183 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.725184 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.725185 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.725191 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.726733 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.727191 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.727193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.727194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.727248 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.727419 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.727420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.727421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.727572 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.727645 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.727829 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.727980 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":24}
I20260809 18:56:57.728137 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.721187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34000 (local address 127.23.229.62:37999)
0809 18:56:57.721238 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.721240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.721399 (+ 159us) server_negotiation.cc:407] Connection header received
0809 18:56:57.721558 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.721559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.721570 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.721615 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.722058 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.722588 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.723351 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.723574 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.723653 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.725044 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.725045 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.725046 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.725054 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.726765 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.727256 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.727257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.727258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.727322 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.727542 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.727543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.727544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.727690 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.727759 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.727963 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.728047 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:56:57.728542 2252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.721145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34000)
0809 18:56:57.721303 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.721339 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.721473 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.721628 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.721629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.721888 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.721964 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.721967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.722674 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.722675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.723261 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.723262 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.723663 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.723664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.723736 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.724380 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.724384 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.724944 (+ 560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.726864 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.726865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.726865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.727158 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.727395 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.727396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.727396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.727465 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.727759 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.727760 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.727802 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.728257 (+ 455us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.728379 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.62@KRBTEST.COM for oryx/127.23.229.61@KRBTEST.COM
I20260809 18:56:57.739683 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.731144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36012 (local address 127.23.229.61:37757)
0809 18:56:57.731186 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.731188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.731343 (+ 155us) server_negotiation.cc:407] Connection header received
0809 18:56:57.731459 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.731460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.731471 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.731523 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.732178 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.732791 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.733979 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.734160 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.734215 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.736670 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.736672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.736673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.736680 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.738319 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.738804 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.738805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.738806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.738864 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.739083 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.739084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.739084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.739218 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.739260 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.739534 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.739614 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:56:57.739748 2259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.731056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.0.0.1:36012)
0809 18:56:57.731221 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.731273 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.731373 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.731541 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.731545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.731964 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.732031 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.732034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.732871 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.732873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.733888 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.733890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.734236 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.734237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.734328 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.734851 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.734857 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.736559 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.738420 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.738430 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.738432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.738708 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.738949 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.738950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.738950 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.739012 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.739306 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.739313 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.739368 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.739480 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.739623 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
I20260809 18:56:57.740800 1348 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.229.61:37757: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e22763e4e9e84e63a134291acd8da39d"
member_type: NON_VOTER
last_known_addr {
host: "127.23.229.61"
port: 37757
}
attrs {
promote: true
}
}
dest_uuid: "2f28714a43be4261a929bfa3fa746b0b"
cas_config_opid_index: -1
I20260809 18:56:57.741274 1348 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } }
I20260809 18:56:57.741878 2261 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER e22763e4e9e84e63a134291acd8da39d (127.23.229.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } }
I20260809 18:56:57.742161 2168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:57.742908 2261 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.229.61:37757
I20260809 18:56:57.743165 2168 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Refusing update from remote peer 2f28714a43be4261a929bfa3fa746b0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 18:56:57.743300 2087 master.cc:537] Master@127.23.229.61:37757 shutting down...
I20260809 18:56:57.743182 2260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } }
I20260809 18:56:57.743606 2260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:57.743743 2260 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:56:57.744553 1323 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 18:56:57.745083 1323 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b -> Peer e22763e4e9e84e63a134291acd8da39d (127.23.229.61:37757): Couldn't send request to peer e22763e4e9e84e63a134291acd8da39d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 18:56:57.746249 2087 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:57.746364 2087 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:57.746423 2087 tablet_replica.cc:330] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: stopping tablet replica
I20260809 18:56:57.749233 2087 master.cc:552] Master@127.23.229.61:37757 shutdown complete.
I20260809 18:56:57.749305 2087 master_runner.cc:305] Clearing existing system tablet
I20260809 18:56:57.749449 2087 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:57.749517 2087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:57.750157 2087 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:57.750689 2268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.750880 2087 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:57.750947 2087 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:57.750979 2087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
uuid: "e22763e4e9e84e63a134291acd8da39d"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "ff7750dfae0de1c61f5f7870282ca6f2"
server_key_iv: "441af053ac6724bf822acdd51b264220"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.751652 2087 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:57.753116 2087 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 18:56:57.753207 2087 log.cc:1196] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 18:56:57.753458 2087 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Deleting consensus metadata
I20260809 18:56:57.753608 2087 master_runner.cc:315] Copying system tablet from 127.23.229.62:37999
I20260809 18:56:57.754228 2087 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: tablet copy: Beginning tablet copy session from remote peer at address 127.23.229.62:37999
I20260809 18:56:57.760866 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.754725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34016 (local address 127.23.229.62:37999)
0809 18:56:57.754781 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.754783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.754820 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:56:57.754897 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.754898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.754907 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.754966 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.755324 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.755890 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.756971 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.757164 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.757220 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.758283 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.758284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.758284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.758290 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.759734 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.760129 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.760130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.760130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.760183 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.760380 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.760380 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.760381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.760528 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.760593 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.760737 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.760798 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:56:57.760952 2279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.754647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34016)
0809 18:56:57.754766 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:57.754775 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:57.754834 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:57.754995 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:57.754996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:57.755207 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:57.755259 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.755261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.755980 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.755981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.756874 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:57.756877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.757239 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.757240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:57.757301 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.757775 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:57.757780 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:57.758192 (+ 412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:57.759814 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.759815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.759816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.760054 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.760249 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:57.760250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:57.760250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:57.760317 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:57.760587 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:57.760588 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:57.760639 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 18:56:57.760720 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 18:56:57.760832 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
I20260809 18:56:57.761695 1381 tablet_copy_service.cc:140] P 2f28714a43be4261a929bfa3fa746b0b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e22763e4e9e84e63a134291acd8da39d ({username='oryx', principal='oryx/127.23.229.61@KRBTEST.COM'} at 127.0.0.1:34016)
I20260809 18:56:57.761858 1381 tablet_copy_service.cc:161] P 2f28714a43be4261a929bfa3fa746b0b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e22763e4e9e84e63a134291acd8da39d at {username='oryx', principal='oryx/127.23.229.61@KRBTEST.COM'} at 127.0.0.1:34016: session id = e22763e4e9e84e63a134291acd8da39d-00000000000000000000000000000000
I20260809 18:56:57.762666 1381 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 18:56:57.763334 2087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 18:56:57.764420 2087 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: tablet copy: Starting download of 0 data blocks...
I20260809 18:56:57.764626 2087 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: tablet copy: Starting download of 1 WAL segments...
I20260809 18:56:57.765714 2087 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 18:56:57.766638 1381 tablet_copy_service.cc:342] P 2f28714a43be4261a929bfa3fa746b0b: Request end of tablet copy session e22763e4e9e84e63a134291acd8da39d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.229.61@KRBTEST.COM'} at 127.0.0.1:34016
I20260809 18:56:57.766693 1381 tablet_copy_service.cc:433] P 2f28714a43be4261a929bfa3fa746b0b: ending tablet copy session e22763e4e9e84e63a134291acd8da39d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e22763e4e9e84e63a134291acd8da39d
I20260809 18:56:57.769572 2087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:57.770884 2286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.770870 2284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.770864 2282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:57.771133 2087 server_base.cc:1034] running on GCE node
I20260809 18:56:57.771229 2087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:57.771358 2087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:57.772562 2087 hybrid_clock.cc:648] HybridClock initialized: now 1786301817772544 us; error 36 us; skew 500 ppm
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:57.774041 2087 init.cc:377] Logged in from keytab as oryx/127.23.229.61@KRBTEST.COM (short username oryx)
I20260809 18:56:57.774341 2087 webserver.cc:460] Webserver started at http://127.23.229.61:46425/ using document root <none> and password file <none>
I20260809 18:56:57.774485 2087 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:57.774528 2087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:57.775184 2087 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:57.775748 2298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.775887 2087 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:57.775934 2087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
uuid: "e22763e4e9e84e63a134291acd8da39d"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "ff7750dfae0de1c61f5f7870282ca6f2"
server_key_iv: "441af053ac6724bf822acdd51b264220"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.776017 2087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:57.818588 2087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:57.820576 2087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:57.823485 2087 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.61:37757
I20260809 18:56:57.823791 2385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.61:37757 every 8 connection(s)
I20260809 18:56:57.823905 2087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
I20260809 18:56:57.824841 2388 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:56:57.825389 2388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Bootstrap starting.
I20260809 18:56:57.828454 2388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:56:57.828735 2388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: Bootstrap complete.
I20260809 18:56:57.828954 2388 raft_consensus.cc:348] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } }
I20260809 18:56:57.829048 2388 raft_consensus.cc:729] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e22763e4e9e84e63a134291acd8da39d, State: Initialized, Role: LEARNER
I20260809 18:56:57.829087 2388 consensus_queue.cc:260] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } }
I20260809 18:56:57.829278 2388 sys_catalog.cc:564] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:57.829280 2395 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } }
I20260809 18:56:57.829428 2395 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: LEARNER
I20260809 18:56:57.830775 2410 catalog_manager.cc:1259] Loaded cluster ID: 2625554564554dc1b8f2725e1ac39bad
I20260809 18:56:57.830840 2410 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: loading cluster ID for follower catalog manager: success
I20260809 18:56:57.831943 2410 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: acquiring CA information for follower catalog manager: success
I20260809 18:56:57.832254 2410 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:56:57.862978 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:57.855891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36038 (local address 127.23.229.61:37757)
0809 18:56:57.856052 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:57.856054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:57.856068 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:56:57.856093 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:57.856094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:57.856104 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:57.856180 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:57.856933 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.857758 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.858530 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:57.858763 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:57.858849 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:57.860304 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:57.860305 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:57.860306 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:57.860314 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:57.861790 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.862157 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.862158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.862159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.862227 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:57.862436 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:57.862437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:57.862437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:57.862558 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:57.862663 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:57.862772 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 18:56:57.862864 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for oryx/127.23.229.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.60.keytab.
Entry for principal oryx/127.23.229.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.60.keytab.
I20260809 18:56:57.891906 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:46543
--webserver_interface=127.23.229.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.60.keytab
--principal=oryx/127.23.229.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:57.977149 2415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:57.977396 2415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:57.977437 2415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:57.978659 2415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:57.978729 2415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:57.978752 2415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:57.978785 2415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:57.978811 2415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:57.980360 2415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.60.keytab
--principal=oryx/127.23.229.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:46543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.229.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:57.980690 2415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:57.980934 2415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:57.985925 2434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.985925 2427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:57.985944 2426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:57.986263 2415 server_base.cc:1034] running on GCE node
I20260809 18:56:57.986541 2415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:57.986927 2415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:57.988119 2415 hybrid_clock.cc:648] HybridClock initialized: now 1786301817988101 us; error 34 us; skew 500 ppm
Aug 09 18:56:57 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:57.991044 2415 init.cc:377] Logged in from keytab as oryx/127.23.229.60@KRBTEST.COM (short username oryx)
I20260809 18:56:57.991480 2415 webserver.cc:460] Webserver started at http://127.23.229.60:38159/ using document root <none> and password file <none>
I20260809 18:56:57.991674 2415 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:57.991714 2415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:57.991808 2415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:57.992965 2415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/instance:
uuid: "e77c98c907024b9e82f8f937005431a3"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3e93b809441152c24bd67995986c79ce"
server_key_iv: "818aa835835499c097b38557ccae350a"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.993301 2415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal/instance:
uuid: "e77c98c907024b9e82f8f937005431a3"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3e93b809441152c24bd67995986c79ce"
server_key_iv: "818aa835835499c097b38557ccae350a"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.994719 2415 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:56:57.995476 2444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:57.995666 2415 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:57.995786 2415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
uuid: "e77c98c907024b9e82f8f937005431a3"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3e93b809441152c24bd67995986c79ce"
server_key_iv: "818aa835835499c097b38557ccae350a"
server_key_version: "encryptionkey@0"
I20260809 18:56:57.995873 2415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:58.010380 2415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:58.012662 2415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:58.012852 2415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:58.017252 2415 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.60:46543
I20260809 18:56:58.017288 2526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.60:46543 every 8 connection(s)
I20260809 18:56:58.017666 2415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
I20260809 18:56:58.018791 2531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:58.020466 2531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.60@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:58.027464 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 2415
I20260809 18:56:58.031152 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.021427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.23.229.62:37999)
0809 18:56:58.021511 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.021514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.021657 (+ 143us) server_negotiation.cc:407] Connection header received
0809 18:56:58.022180 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.022182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.022195 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.022249 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.022945 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.023473 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.024534 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.024738 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.024832 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.027200 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.027202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.027202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.027210 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.029309 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.029921 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.029922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.029923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.030001 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.030326 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.030328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.030328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.030481 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.030569 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.030999 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.031078 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 18:56:58.031394 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.021285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34032)
0809 18:56:58.021523 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.021570 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.022066 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.022340 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.022343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.022626 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.022838 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.022842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.023580 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.023581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.024414 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.024417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.024859 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.024861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.024997 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.025575 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.025597 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.027105 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.029460 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.029472 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.029474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.029807 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.030091 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.030092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.030092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.030263 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.030563 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.030571 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.030829 (+ 258us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.030963 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.031149 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":117,"threads_started":1}
I20260809 18:56:58.032214 2531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.229.60@KRBTEST.COM
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.60@KRBTEST.COM for oryx/127.23.229.61@KRBTEST.COM
I20260809 18:56:58.038336 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.028341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59096 (local address 127.23.229.60:46543)
0809 18:56:58.028544 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.028548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.028566 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:56:58.028585 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.028587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.028599 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.028668 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.029465 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.030618 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.031722 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.032060 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.032195 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.034754 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.034763 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.034763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.034770 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.036645 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.037025 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.037029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.037029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.037096 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.037384 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.037384 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.037385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.037587 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.037763 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.038120 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.038206 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":112,"threads_started":1}
I20260809 18:56:58.040194 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.032542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.0.0.1:36040)
0809 18:56:58.032719 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.032729 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.032791 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.032948 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.032949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.033095 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.033139 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.033140 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.034386 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.034387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.035064 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.035066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.035660 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.035661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.035747 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.036137 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.036141 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.037438 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.039424 (+ 1986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.039425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.039425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.039589 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.039747 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.039747 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.039747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.039787 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.039977 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.039978 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.040010 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.040063 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.040131 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260809 18:56:58.040457 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.032598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36040 (local address 127.23.229.61:37757)
0809 18:56:58.032647 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.032648 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.032780 (+ 132us) server_negotiation.cc:407] Connection header received
0809 18:56:58.032858 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.032859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.032874 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.032945 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.033217 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.033701 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.035164 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.035521 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.035607 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.037519 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.037521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.037521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.037529 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.039349 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.039653 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.039654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.039654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.039707 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.039835 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.039835 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.039836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.039938 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.039988 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.040131 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.040216 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:56:58.040902 2531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301817, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.60@KRBTEST.COM for oryx/127.23.229.60@KRBTEST.COM
I20260809 18:56:58.047008 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.041166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.0.0.1:59108)
0809 18:56:58.041213 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.041224 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.041268 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.041391 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.041392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.041531 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.041559 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.041560 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.042202 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.042203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.042674 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.042675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.043054 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.043055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.043104 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.043485 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.043489 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.044659 (+ 1170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.045998 (+ 1339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.045999 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.045999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.046164 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.046365 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.046365 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.046366 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.046422 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.046674 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.046676 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.046713 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.046782 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.046888 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 18:56:58.047055 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.041221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59108 (local address 127.23.229.60:46543)
0809 18:56:58.041254 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.041256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.041264 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:58.041323 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.041324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.041335 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.041388 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.041628 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.042112 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.042752 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.042976 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.043059 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.044750 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.044751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.044751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.044758 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.045892 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.046245 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.046246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.046247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.046301 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.046493 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.046494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.046495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.046609 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.046685 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.046807 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.046938 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":18}
I20260809 18:56:58.048784 2531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Bootstrap starting.
I20260809 18:56:58.049703 2531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:58.050017 2531 log.cc:824] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:58.050961 2531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: No bootstrap required, opened a new log
I20260809 18:56:58.052624 2531 raft_consensus.cc:348] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } }
I20260809 18:56:58.052763 2531 raft_consensus.cc:374] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:58.052786 2531 raft_consensus.cc:729] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e77c98c907024b9e82f8f937005431a3, State: Initialized, Role: FOLLOWER
I20260809 18:56:58.052946 2531 consensus_queue.cc:260] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } }
I20260809 18:56:58.053311 2531 sys_catalog.cc:564] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:58.053272 2537 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } } }
I20260809 18:56:58.053409 2537 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:56:58.055284 2553 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:56:58.055385 2553 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:56:58.057957 2415 master_runner.cc:428] Detected that this master e77c98c907024b9e82f8f937005431a3 is joining an existing cluster
I20260809 18:56:58.058030 2415 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.229.60:46543
I20260809 18:56:58.066848 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.059558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34040 (local address 127.23.229.62:37999)
0809 18:56:58.059631 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.059633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.059642 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:58.059668 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.059669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.059687 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.059750 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.060136 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.060877 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.062012 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.062305 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.062346 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.063670 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.063671 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.063672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.063679 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.065286 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.065790 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.065792 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.065792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.065858 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.066102 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.066103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.066104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.066281 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.066341 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.066643 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.066743 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:56:58.067323 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.059404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59112 (local address 127.23.229.60:46543)
0809 18:56:58.059442 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.059443 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.060813 (+ 1370us) server_negotiation.cc:407] Connection header received
0809 18:56:58.060891 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.060892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.060900 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.060927 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.061385 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.062089 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.063048 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.063328 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.063370 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.064421 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.064423 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.064423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.064430 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.066091 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.066439 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.066440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.066440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.066487 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.066696 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.066697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.066697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.066805 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.066886 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.067036 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.067177 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":20}
I20260809 18:56:58.067261 2561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.059105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34040)
0809 18:56:58.059310 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.059321 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.059387 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.059773 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.059774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.059974 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.060048 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.060050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.060970 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.060971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.061917 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.061920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.062446 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.062447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.062508 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.063061 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.063066 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.063571 (+ 505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.065383 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.065383 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.065384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.065694 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.065942 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.065943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.065943 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.066027 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.066441 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.066442 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.066494 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.066991 (+ 497us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.067112 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":142,"threads_started":1}
I20260809 18:56:58.067525 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.059373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.0.0.1:59112)
0809 18:56:58.060761 (+ 1388us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.060769 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.060831 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.060984 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.060984 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.061243 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.061304 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.061306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.062178 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.062179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.062965 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.062968 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.063440 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.063441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.063508 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.063935 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.063940 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.064334 (+ 394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.066161 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.066161 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.066162 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.066356 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.066558 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.066559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.066560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.066617 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.066878 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.066878 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.066918 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.067064 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.067344 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1375,"mutex_wait_us":196,"thread_start_us":68,"threads_started":1}
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.62@KRBTEST.COM for oryx/127.23.229.60@KRBTEST.COM
I20260809 18:56:58.079723 2259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.070105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.0.0.1:59122)
0809 18:56:58.070157 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.070167 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.070204 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.070333 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.070334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.070516 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.070559 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.070561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.071202 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.071204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.071733 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.071735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.072114 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.072115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.072191 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.072662 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.072668 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.073942 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.078490 (+ 4548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.078492 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.078493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.078713 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.078966 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.078967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.078967 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.079034 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.079312 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.079313 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.079372 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.079444 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.079588 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:56:58.080120 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.070165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59122 (local address 127.23.229.60:46543)
0809 18:56:58.070206 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.070208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.070216 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:58.070271 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.070272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.070281 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.070331 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.070639 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.071116 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.071831 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.072039 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.072116 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.074046 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.074047 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.074048 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.074056 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.078340 (+ 4284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.078815 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.078817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.078818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.078888 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.079106 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.079107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.079107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.079236 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.079307 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.079949 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.080033 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:56:58.080636 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.059570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36052 (local address 127.23.229.61:37757)
0809 18:56:58.059638 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.059640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.060682 (+ 1042us) server_negotiation.cc:407] Connection header received
0809 18:56:58.060735 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.060736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.060747 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.060803 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.061329 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.062048 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.062982 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.063283 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.063350 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.077619 (+ 14269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.077622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.077622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.077633 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.079286 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.079662 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.079663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.079664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.079728 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.079977 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.079978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.079978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.080127 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.080176 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.080428 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.080546 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:56:58.080698 1348 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.229.60:46543: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e77c98c907024b9e82f8f937005431a3"
member_type: NON_VOTER
last_known_addr {
host: "127.23.229.60"
port: 46543
}
attrs {
promote: true
}
}
dest_uuid: "2f28714a43be4261a929bfa3fa746b0b"
cas_config_opid_index: 5
I20260809 18:56:58.081029 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.059124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.0.0.1:36052)
0809 18:56:58.060594 (+ 1470us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.060606 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.060675 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.060859 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.060860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.061163 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.061235 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.061237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.062130 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.062130 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.062856 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.062859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.063407 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.063408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.063471 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.076960 (+ 13489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.076966 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.077449 (+ 483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.079372 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.079373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.079373 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.079580 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.079806 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.079807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.079808 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.079877 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.080229 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.080230 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.080291 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.080765 (+ 474us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.080884 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1450,"thread_start_us":117,"threads_started":1}
I20260809 18:56:58.080994 1348 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } }
I20260809 18:56:58.081609 2260 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e77c98c907024b9e82f8f937005431a3 (127.23.229.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.082692 2260 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.229.60:46543
I20260809 18:56:58.082787 2260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.082861 2260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.082969 2415 master.cc:537] Master@127.23.229.60:46543 shutting down...
W20260809 18:56:58.085029 1323 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b -> Peer e77c98c907024b9e82f8f937005431a3 (127.23.229.60:46543): Couldn't send request to peer e77c98c907024b9e82f8f937005431a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 18:56:58.086222 2415 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:58.086323 2415 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:58.086375 2415 tablet_replica.cc:330] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: stopping tablet replica
I20260809 18:56:58.087069 2259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.083089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.0.0.1:36064)
0809 18:56:58.083439 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.083450 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.083512 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.083757 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.083758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.083760 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:58.083815 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.083816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.085021 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.085022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.086114 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.086117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.086801 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.086802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.086865 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.086891 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.086960 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.086998 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331}
I20260809 18:56:58.087375 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.083257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36064 (local address 127.23.229.61:37757)
0809 18:56:58.083344 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.083347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.083517 (+ 170us) server_negotiation.cc:407] Connection header received
0809 18:56:58.083571 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.083572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.083612 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.083686 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:58.083892 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.084934 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.086216 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.086713 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.086802 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.086879 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.086960 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.086997 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:56:58.087639 2346 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 LEARNER]: Refusing update from remote peer 2f28714a43be4261a929bfa3fa746b0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 18:56:58.087847 2564 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 18:56:58.088449 2346 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e77c98c907024b9e82f8f937005431a3 (127.23.229.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.089747 2567 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.089847 2567 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: LEARNER
I20260809 18:56:58.090086 2395 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f28714a43be4261a929bfa3fa746b0b. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: NON_VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: true } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.090183 2395 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: LEARNER
I20260809 18:56:58.090445 2261 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: attempting to promote NON_VOTER e22763e4e9e84e63a134291acd8da39d to VOTER
I20260809 18:56:58.090698 2261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } }
I20260809 18:56:58.091224 2259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.091087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.0.0.1:59128)
0809 18:56:58.091122 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.091191 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:46543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 18:56:58.091274 2346 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 LEARNER]: Refusing update from remote peer 2f28714a43be4261a929bfa3fa746b0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 18:56:58.091691 2259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.091542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.0.0.1:59132)
0809 18:56:58.091594 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.091648 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:46543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:56:58.091638 2564 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260809 18:56:58.091805 1323 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b -> Peer e77c98c907024b9e82f8f937005431a3 (127.23.229.60:46543): Couldn't send request to peer e77c98c907024b9e82f8f937005431a3. Status: Network error: Client connection negotiation failed: client connection to 127.23.229.60:46543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 18:56:58.092382 2261 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e22763e4e9e84e63a134291acd8da39d (127.23.229.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.093228 2261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.093312 2261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.093276 2260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.093364 2260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.093573 2346 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e22763e4e9e84e63a134291acd8da39d (127.23.229.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.094363 2395 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.094466 2395 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:56:58.100081 2415 master.cc:552] Master@127.23.229.60:46543 shutdown complete.
I20260809 18:56:58.100139 2415 master_runner.cc:305] Clearing existing system tablet
I20260809 18:56:58.100276 2415 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:58.100325 2415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:58.101251 2415 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:58.101861 2569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.102013 2415 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:58.102080 2415 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:58.102106 2415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
uuid: "e77c98c907024b9e82f8f937005431a3"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3e93b809441152c24bd67995986c79ce"
server_key_iv: "818aa835835499c097b38557ccae350a"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.102993 2415 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:58.104518 2415 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 18:56:58.104595 2415 log.cc:1196] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 18:56:58.104812 2415 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Deleting consensus metadata
I20260809 18:56:58.104939 2415 master_runner.cc:315] Copying system tablet from 127.23.229.62:37999
I20260809 18:56:58.105600 2415 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: tablet copy: Beginning tablet copy session from remote peer at address 127.23.229.62:37999
I20260809 18:56:58.112720 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.105941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34056)
0809 18:56:58.106061 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.106073 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.106145 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.106300 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.106301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.106467 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.106528 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.106529 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.107509 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.107510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.108093 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.108094 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.108691 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.108692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.108748 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.109343 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.109348 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.109694 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.111588 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.111589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.111589 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.111785 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.112012 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.112013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.112013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.112069 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.112351 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.112352 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.112394 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.112446 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.112617 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":77,"threads_started":1}
I20260809 18:56:58.112725 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.106021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34056 (local address 127.23.229.62:37999)
0809 18:56:58.106078 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.106081 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.106132 (+ 51us) server_negotiation.cc:407] Connection header received
0809 18:56:58.106218 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.106219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.106231 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.106287 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.106604 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.107412 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.108185 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.108613 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.108691 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.109790 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.109791 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.109792 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.109800 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.111483 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.111871 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.111872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.111873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.111943 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.112135 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.112135 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.112136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.112285 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.112359 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.112534 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.112627 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:56:58.113201 1381 tablet_copy_service.cc:140] P 2f28714a43be4261a929bfa3fa746b0b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e77c98c907024b9e82f8f937005431a3 ({username='oryx', principal='oryx/127.23.229.60@KRBTEST.COM'} at 127.0.0.1:34056)
I20260809 18:56:58.113286 1381 tablet_copy_service.cc:161] P 2f28714a43be4261a929bfa3fa746b0b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e77c98c907024b9e82f8f937005431a3 at {username='oryx', principal='oryx/127.23.229.60@KRBTEST.COM'} at 127.0.0.1:34056: session id = e77c98c907024b9e82f8f937005431a3-00000000000000000000000000000000
I20260809 18:56:58.113798 1381 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 18:56:58.114437 2415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 18:56:58.115477 2415 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: tablet copy: Starting download of 0 data blocks...
I20260809 18:56:58.115705 2415 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: tablet copy: Starting download of 1 WAL segments...
I20260809 18:56:58.116673 2415 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 18:56:58.117511 1381 tablet_copy_service.cc:342] P 2f28714a43be4261a929bfa3fa746b0b: Request end of tablet copy session e77c98c907024b9e82f8f937005431a3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.229.60@KRBTEST.COM'} at 127.0.0.1:34056
I20260809 18:56:58.117581 1381 tablet_copy_service.cc:433] P 2f28714a43be4261a929bfa3fa746b0b: ending tablet copy session e77c98c907024b9e82f8f937005431a3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e77c98c907024b9e82f8f937005431a3
I20260809 18:56:58.120128 2415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:58.121450 2584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.121529 2588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.121529 2583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:58.121766 2415 server_base.cc:1034] running on GCE node
I20260809 18:56:58.121866 2415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:58.122012 2415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:58.123142 2415 hybrid_clock.cc:648] HybridClock initialized: now 1786301818123140 us; error 39 us; skew 500 ppm
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:58.124601 2415 init.cc:377] Logged in from keytab as oryx/127.23.229.60@KRBTEST.COM (short username oryx)
I20260809 18:56:58.124888 2415 webserver.cc:460] Webserver started at http://127.23.229.60:37573/ using document root <none> and password file <none>
I20260809 18:56:58.125030 2415 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:58.125088 2415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:58.125824 2415 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:58.126398 2600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.126531 2415 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:56:58.126581 2415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
uuid: "e77c98c907024b9e82f8f937005431a3"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3e93b809441152c24bd67995986c79ce"
server_key_iv: "818aa835835499c097b38557ccae350a"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.126642 2415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:58.134291 2415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:58.135924 2415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:58.139261 2415 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.60:46543
I20260809 18:56:58.139606 2690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.60:46543 every 8 connection(s)
I20260809 18:56:58.139721 2415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
I20260809 18:56:58.140969 2692 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:56:58.141479 2692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Bootstrap starting.
I20260809 18:56:58.144809 2692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:56:58.145051 2692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Bootstrap complete.
I20260809 18:56:58.145283 2692 raft_consensus.cc:348] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } }
I20260809 18:56:58.145376 2692 raft_consensus.cc:729] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e77c98c907024b9e82f8f937005431a3, State: Initialized, Role: LEARNER
I20260809 18:56:58.145418 2692 consensus_queue.cc:260] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } }
I20260809 18:56:58.145622 2692 sys_catalog.cc:564] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:58.146190 2702 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.146287 2702 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:56:58.147496 2723 catalog_manager.cc:1259] Loaded cluster ID: 2625554564554dc1b8f2725e1ac39bad
I20260809 18:56:58.147519 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.140070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59144 (local address 127.23.229.60:46543)
0809 18:56:58.140211 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.140213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.140223 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:56:58.140249 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.140249 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.140262 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.140363 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.141109 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.141851 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.142554 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.142791 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.142895 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.144224 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.144225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.144225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.144234 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.146005 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.146482 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.146483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.146484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.146549 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.146768 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.146770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.146770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.146925 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.147057 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.147306 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.147400 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260809 18:56:58.147540 2723 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: loading cluster ID for follower catalog manager: success
I20260809 18:56:58.148538 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 1454
I20260809 18:56:58.148759 2723 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: acquiring CA information for follower catalog manager: success
I20260809 18:56:58.149127 2723 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:56:58.157209 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:42237
--local_ip_for_outbound_sockets=127.23.229.1
--tserver_master_addrs=127.23.229.62:37999
--webserver_port=35157
--webserver_interface=127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab
--principal=oryx/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:58.245299 2724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:58.245568 2724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:58.245612 2724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:58.247049 2724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:58.247120 2724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:58.247169 2724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:56:58.248761 2724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab
--principal=oryx/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:42237
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=35157
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:58.249049 2724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:58.249300 2724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:58.254686 2732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.254686 2729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.254693 2730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:58.254720 2724 server_base.cc:1034] running on GCE node
I20260809 18:56:58.255214 2724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:58.255498 2724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:58.256662 2724 hybrid_clock.cc:648] HybridClock initialized: now 1786301818256638 us; error 58 us; skew 500 ppm
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:58.259529 2724 init.cc:377] Logged in from keytab as oryx/127.23.229.1@KRBTEST.COM (short username oryx)
I20260809 18:56:58.260025 2724 webserver.cc:460] Webserver started at http://127.23.229.1:35157/ using document root <none> and password file <none>
I20260809 18:56:58.260219 2724 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:58.260274 2724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:58.261646 2724 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:58.262190 2741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.262389 2724 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.262463 2724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "fbbd68703549461ebc2dc5bbedcee8a1"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "9ae3e2b50bb3ef6482938e603a858577"
server_key_iv: "322b86c3c2d70c78060d4a4df0811076"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.262796 2724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:58.281989 2724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:58.284853 2724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:58.284992 2724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:58.285243 2724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:58.285619 2724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:58.285657 2724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.285703 2724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:58.285732 2724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.292043 2724 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:42237
I20260809 18:56:58.292131 2935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:42237 every 8 connection(s)
I20260809 18:56:58.292611 2724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:58.293325 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 2724
I20260809 18:56:58.293524 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 1664
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:58.310894 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.293795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:58937 (local address 127.23.229.62:37999)
0809 18:56:58.293849 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.293852 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.300930 (+ 7078us) server_negotiation.cc:407] Connection header received
0809 18:56:58.301626 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.301628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.301644 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.301708 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.302895 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.303428 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.304583 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.304788 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.304873 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.307450 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.307451 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.307452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.307461 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.309237 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.309777 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.309778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.309779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.309853 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.310148 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.310149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.310150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.310278 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.310365 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.310684 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.310777 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:56:58.311113 2945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.293513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:58937)
0809 18:56:58.300686 (+ 7173us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.300789 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.301488 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.301799 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.301803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.302547 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.302777 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.302783 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.303558 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.303560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.304428 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.304430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.304885 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.304887 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.305044 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.305660 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.305670 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.307343 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.309319 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.309328 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.309331 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.309690 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.309937 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.309938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.309938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.310072 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.310357 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.310365 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.310533 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.310649 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.310845 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7097,"thread_start_us":99,"threads_started":1}
I20260809 18:56:58.311632 2937 heartbeater.cc:347] Connected to a master server at 127.23.229.62:37999
I20260809 18:56:58.311735 2937 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.311978 2937 heartbeater.cc:511] Master 127.23.229.62:37999 requested a full tablet report, sending...
I20260809 18:56:58.312558 1348 ts_manager.cc:194] Re-registered known tserver with Master: fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237)
I20260809 18:56:58.313093 1348 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:58937
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.61@KRBTEST.COM
I20260809 18:56:58.314343 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:42087
--local_ip_for_outbound_sockets=127.23.229.2
--tserver_master_addrs=127.23.229.62:37999
--webserver_port=46413
--webserver_interface=127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab
--principal=oryx/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:56:58.317411 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.307698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:34723 (local address 127.23.229.61:37757)
0809 18:56:58.307753 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.307755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.308646 (+ 891us) server_negotiation.cc:407] Connection header received
0809 18:56:58.308685 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.308686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.308700 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.308768 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.309260 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.309827 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.311073 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.311411 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.311456 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.314351 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.314353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.314354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.314365 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.316107 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.316566 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.316567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.316568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.316636 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.316827 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.316827 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.316828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.316962 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.317041 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.317220 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.317312 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 18:56:58.317785 2947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.307613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.23.229.1:34723)
0809 18:56:58.308576 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.308585 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.308630 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.308794 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.308794 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.309056 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.309152 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.309154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.309941 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.309942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.310963 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.310967 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.311541 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.311542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.311614 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.312121 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.312128 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.314250 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.316206 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.316207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.316208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.316421 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.316698 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.316699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.316699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.316748 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.317051 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.317052 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.317101 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.317516 (+ 415us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.317668 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":948,"thread_start_us":80,"threads_started":1}
I20260809 18:56:58.318289 2938 heartbeater.cc:347] Connected to a master server at 127.23.229.61:37757
I20260809 18:56:58.318372 2938 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.318495 2938 heartbeater.cc:511] Master 127.23.229.61:37757 requested a full tablet report, sending...
I20260809 18:56:58.318969 2326 ts_manager.cc:194] Registered new tserver with Master: fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237)
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.60@KRBTEST.COM
I20260809 18:56:58.322885 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.312687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:34423 (local address 127.23.229.60:46543)
0809 18:56:58.312738 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.312740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.312749 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:58.312776 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.312776 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.312793 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.312853 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.314049 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.314789 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.317092 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.317406 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.317478 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.320085 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.320086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.320087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.320096 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.321677 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.322044 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.322046 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.322046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.322103 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.322310 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.322311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.322311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.322435 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.322516 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.322693 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.322784 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:56:58.322906 2949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.306870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.23.229.1:34423)
0809 18:56:58.308385 (+ 1515us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.308399 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.308472 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.313621 (+ 5149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.313623 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.313821 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.313912 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.313914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.314873 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.315257 (+ 384us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.316958 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.316962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.317676 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.317677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.317752 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.318631 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.318636 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.319973 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.321763 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.321764 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.321764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.321947 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.322178 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.322179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.322179 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.322244 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.322507 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.322508 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.322561 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.322663 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.322785 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1493,"thread_start_us":600,"threads_started":1}
I20260809 18:56:58.323328 2936 heartbeater.cc:347] Connected to a master server at 127.23.229.60:46543
I20260809 18:56:58.323388 2936 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.323457 2936 heartbeater.cc:511] Master 127.23.229.60:46543 requested a full tablet report, sending...
I20260809 18:56:58.323966 2632 ts_manager.cc:194] Registered new tserver with Master: fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237)
W20260809 18:56:58.407825 2950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:58.408077 2950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:58.408104 2950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:58.409389 2950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:58.409446 2950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:58.409474 2950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:56:58.411334 2950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab
--principal=oryx/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:42087
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=46413
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:58.411660 2950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:58.411902 2950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:58.417480 2957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.417501 2959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.417480 2956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:58.417622 2950 server_base.cc:1034] running on GCE node
I20260809 18:56:58.417884 2950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:58.418202 2950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:58.419378 2950 hybrid_clock.cc:648] HybridClock initialized: now 1786301818419364 us; error 32 us; skew 500 ppm
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:58.422192 2950 init.cc:377] Logged in from keytab as oryx/127.23.229.2@KRBTEST.COM (short username oryx)
I20260809 18:56:58.422621 2950 webserver.cc:460] Webserver started at http://127.23.229.2:46413/ using document root <none> and password file <none>
I20260809 18:56:58.422842 2950 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:58.422896 2950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:58.424266 2950 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:58.424993 2970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.425184 2950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:56:58.425287 2950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "88d96d0c6573489282a0da1e316caa74"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "3b62fdf8940a68a9ffee39d435a13dcf"
server_key_iv: "1b22c9a535efcd700cd3d9b1f6b0129f"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.425648 2950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:58.470033 2950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:58.472429 2950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:58.472627 2950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:58.472867 2950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:58.473242 2950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:58.473282 2950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.473306 2950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:58.473366 2950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.479641 2950 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:42087
I20260809 18:56:58.479727 3171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:42087 every 8 connection(s)
I20260809 18:56:58.480155 2950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:58.481853 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 2950
I20260809 18:56:58.482031 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 1885
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.61@KRBTEST.COM
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:58.493402 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.481048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:58781 (local address 127.23.229.61:37757)
0809 18:56:58.481310 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.481312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.481337 (+ 25us) server_negotiation.cc:407] Connection header received
0809 18:56:58.482727 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.482730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.482744 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.482772 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.483708 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.484377 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.486555 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.486970 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.487026 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.489991 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.489993 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.489993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.490002 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.491746 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.492254 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.492255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.492256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.492309 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.492633 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.492634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.492634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.492776 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.492815 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.493165 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.493254 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230}
I20260809 18:56:58.493994 3183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.481026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.23.229.2:58781)
0809 18:56:58.481224 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.481267 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.482604 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.482954 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.482958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.483330 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.483609 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.483613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.484639 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.484640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.486418 (+ 1778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.486422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.487136 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.487137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.487285 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.487972 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.487983 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.489874 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.491858 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.491869 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.491872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.492176 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.492386 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.492387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.492387 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.492567 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.492856 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.492862 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.493032 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.493533 (+ 501us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.493722 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":48,"thread_start_us":124,"threads_started":1}
I20260809 18:56:58.495710 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.481066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:36057 (local address 127.23.229.62:37999)
0809 18:56:58.481127 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.481129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.481352 (+ 223us) server_negotiation.cc:407] Connection header received
0809 18:56:58.485050 (+ 3698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.485053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.485068 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.485101 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.485603 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.486246 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.487200 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.488097 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.488156 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.491789 (+ 3633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.491792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.491793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.491803 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.494025 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.494556 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.494557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.494558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.494636 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.494907 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.494909 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.494909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.495097 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.495151 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.495432 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.495557 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:56:58.496176 3184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.481026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:36057)
0809 18:56:58.481223 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.481267 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.484932 (+ 3665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.485183 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.485184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.485382 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.485520 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.485521 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.486325 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.486326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.487089 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.487091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.488262 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.488264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.488352 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.489050 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.489057 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.491647 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.494147 (+ 2500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.494148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.494149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.494427 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.494730 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.494731 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.494732 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.494810 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.495211 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.495212 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.495271 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.495851 (+ 580us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.495998 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":2,"thread_start_us":113,"threads_started":1}
I20260809 18:56:58.496592 3179 heartbeater.cc:347] Connected to a master server at 127.23.229.61:37757
I20260809 18:56:58.496695 3179 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.496896 3179 heartbeater.cc:511] Master 127.23.229.61:37757 requested a full tablet report, sending...
I20260809 18:56:58.497483 2326 ts_manager.cc:194] Registered new tserver with Master: 88d96d0c6573489282a0da1e316caa74 (127.23.229.2:42087)
I20260809 18:56:58.501952 3178 heartbeater.cc:347] Connected to a master server at 127.23.229.62:37999
I20260809 18:56:58.502058 3178 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.502151 3178 heartbeater.cc:511] Master 127.23.229.62:37999 requested a full tablet report, sending...
I20260809 18:56:58.502511 1348 ts_manager.cc:194] Re-registered known tserver with Master: 88d96d0c6573489282a0da1e316caa74 (127.23.229.2:42087)
I20260809 18:56:58.502929 1348 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:36057
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.60@KRBTEST.COM
I20260809 18:56:58.507159 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:38819
--local_ip_for_outbound_sockets=127.23.229.3
--tserver_master_addrs=127.23.229.62:37999
--webserver_port=36337
--webserver_interface=127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab
--principal=oryx/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:56:58.510245 3186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.481363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.23.229.2:51145)
0809 18:56:58.481528 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.481540 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.501813 (+ 20273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.502179 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.502181 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.502438 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.502520 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.502522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.503527 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.503528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.504562 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.504566 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.504940 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.504942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.505019 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.505491 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.505498 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.507064 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.509065 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.509066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.509067 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.509246 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.509510 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.509511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.509511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.509584 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.509919 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.509920 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.509965 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.510045 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.510155 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260809 18:56:58.510259 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.481571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:51145 (local address 127.23.229.60:46543)
0809 18:56:58.481622 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.481624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.481632 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:58.501964 (+ 20332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.501966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.501987 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.502063 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.502631 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.503420 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.504658 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.504856 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.504917 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.507166 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.507168 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.507168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.507176 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.508957 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.509333 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.509334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.509335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.509404 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.509663 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.509663 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.509664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.509823 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.509911 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.510093 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.510183 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:56:58.510690 3177 heartbeater.cc:347] Connected to a master server at 127.23.229.60:46543
I20260809 18:56:58.510754 3177 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.510914 3177 heartbeater.cc:511] Master 127.23.229.60:46543 requested a full tablet report, sending...
I20260809 18:56:58.511250 2632 ts_manager.cc:194] Registered new tserver with Master: 88d96d0c6573489282a0da1e316caa74 (127.23.229.2:42087)
W20260809 18:56:58.594677 3187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:58.594969 3187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:58.595010 3187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:58.596424 3187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:58.596542 3187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:58.596602 3187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:56:58.598194 3187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab
--principal=oryx/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:38819
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=36337
--tserver_master_addrs=127.23.229.62:37999,127.23.229.61:37757,127.23.229.60:46543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:56:58.598518 3187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:58.598770 3187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:58.603988 3198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.604007 3202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.604072 3195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:58.604389 3187 server_base.cc:1034] running on GCE node
I20260809 18:56:58.604631 3187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:58.604898 3187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:58.606057 3187 hybrid_clock.cc:648] HybridClock initialized: now 1786301818606046 us; error 32 us; skew 500 ppm
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:58.608544 3187 init.cc:377] Logged in from keytab as oryx/127.23.229.3@KRBTEST.COM (short username oryx)
I20260809 18:56:58.609038 3187 webserver.cc:460] Webserver started at http://127.23.229.3:36337/ using document root <none> and password file <none>
I20260809 18:56:58.609288 3187 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:58.609376 3187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:58.610728 3187 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:56:58.611330 3216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.611502 3187 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:56:58.611603 3187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "c8e6c689f4c34713b5d9f237b3aa89ad"
format_stamp: "Formatted at 2026-08-09 18:56:57 on dist-test-slave-jq4t"
server_key: "1e2319beaad37372df946c5d405aba3c"
server_key_iv: "737226958ce41f49333cf4a9d4ee7498"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.611958 3187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:58.630839 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.627493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59160 (local address 127.23.229.60:46543)
0809 18:56:58.627540 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.627543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.627633 (+ 90us) server_negotiation.cc:407] Connection header received
0809 18:56:58.627738 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.627739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.627791 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.627872 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:58.628042 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.628688 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.629919 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.630509 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.630592 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.630678 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.630707 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.630745 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:56:58.630831 3225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.627410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.0.0.1:59160)
0809 18:56:58.627536 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.627550 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.627658 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.627886 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.627887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.627890 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:58.627961 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.627963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.628798 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.628799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.629757 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.629760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.630598 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.630600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.630657 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.630661 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.630700 (+ 39us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.630741 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":64,"threads_started":1}
I20260809 18:56:58.631353 2653 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 18:56:58.631542 2702 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f28714a43be4261a929bfa3fa746b0b. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.631687 2702 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:56:58.632105 3187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:58.634140 3187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:58.634282 3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:58.634572 3187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:58.634922 3187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:58.634966 3187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.634991 3187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:58.635040 3187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.641415 3187 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:38819
I20260809 18:56:58.641460 3408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:38819 every 8 connection(s)
I20260809 18:56:58.641834 3187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:58.644250 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 3187
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.60@KRBTEST.COM
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.61@KRBTEST.COM
Aug 09 18:56:58 dist-test-slave-jq4t krb5kdc[1266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:56:58.653781 3414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.642621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.23.229.3:35811)
0809 18:56:58.642801 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.642838 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.643490 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.643816 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.643817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.644150 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.644357 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.644362 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.645125 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.645126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.646156 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.646159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.646632 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.646633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.646794 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.647447 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.647456 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.649552 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.651601 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.651609 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.651612 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.652315 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.652574 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.652574 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.652575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.652715 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.653038 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.653044 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.653216 (+ 172us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.653346 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.653532 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260809 18:56:58.654331 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.642614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:35811 (local address 127.23.229.60:46543)
0809 18:56:58.642686 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.642688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.642924 (+ 236us) server_negotiation.cc:407] Connection header received
0809 18:56:58.643730 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.643731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.643740 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.643811 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.644452 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.644999 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.646275 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.646547 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.646622 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.649664 (+ 3042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.649665 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.649666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.649674 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.651511 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.652411 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.652413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.652413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.652479 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.652788 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.652789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.652790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.652951 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.653011 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.654155 (+ 1144us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.654245 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:56:58.654721 3409 heartbeater.cc:347] Connected to a master server at 127.23.229.60:46543
I20260809 18:56:58.654853 3409 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.655134 3409 heartbeater.cc:511] Master 127.23.229.60:46543 requested a full tablet report, sending...
I20260809 18:56:58.655674 2632 ts_manager.cc:194] Registered new tserver with Master: c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3:38819)
I20260809 18:56:58.655897 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.643202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:40769 (local address 127.23.229.62:37999)
0809 18:56:58.643269 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.643271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.643402 (+ 131us) server_negotiation.cc:407] Connection header received
0809 18:56:58.643605 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.643607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.643620 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.643652 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.645720 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.646550 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.648096 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.648429 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.648559 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.652244 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.652245 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.652246 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.652255 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.654157 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.654672 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.654673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.654674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.654740 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.655031 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.655033 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.655034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.655429 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.655486 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.655715 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.655805 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:56:58.656138 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.643030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:36771 (local address 127.23.229.61:37757)
0809 18:56:58.643081 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.643082 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.643092 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:56:58.643607 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.643609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.643623 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.643669 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.644614 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.645414 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.646704 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.647003 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.647052 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.650184 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.650185 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.650186 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.650194 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.651987 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.655168 (+ 3181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.655169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.655170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.655238 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.655491 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.655493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.655493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.655647 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.655708 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.655926 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.656021 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 18:56:58.656209 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.643133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:40769)
0809 18:56:58.643329 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.643337 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.643509 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.643790 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.643796 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.645547 (+ 1751us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.645616 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.645618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.646677 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.646678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.647967 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.647970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.648626 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.648627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.648694 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.649132 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.649138 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.652136 (+ 2998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.654259 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.654260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.654261 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.654608 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.654883 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.654884 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.654885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.654940 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.655552 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.655553 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.655596 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.655989 (+ 393us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.656108 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":78,"threads_started":1}
I20260809 18:56:58.656697 3416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.642923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.23.229.3:36771)
0809 18:56:58.643034 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.643044 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.643507 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.644181 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.644182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.644376 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:58.644453 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.644455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.645518 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.645518 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.646605 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.646608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.647141 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.647142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.647207 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.647599 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:58.647604 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:58.650061 (+ 2457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:58.654710 (+ 4649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.654711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.654711 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.655062 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.655338 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:58.655338 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:58.655339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:58.655409 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:58.655748 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:58.655748 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:58.655792 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.656424 (+ 632us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.656565 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":12,"thread_start_us":64,"threads_started":1}
I20260809 18:56:58.656827 3410 heartbeater.cc:347] Connected to a master server at 127.23.229.62:37999
I20260809 18:56:58.656893 3410 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.656968 3410 heartbeater.cc:511] Master 127.23.229.62:37999 requested a full tablet report, sending...
I20260809 18:56:58.657291 1348 ts_manager.cc:194] Re-registered known tserver with Master: c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3:38819)
I20260809 18:56:58.657316 3412 heartbeater.cc:347] Connected to a master server at 127.23.229.61:37757
I20260809 18:56:58.657352 3412 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:58.657405 3412 heartbeater.cc:511] Master 127.23.229.61:37757 requested a full tablet report, sending...
I20260809 18:56:58.657790 1348 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:40769
I20260809 18:56:58.658051 2326 ts_manager.cc:194] Registered new tserver with Master: c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3:38819)
I20260809 18:56:58.661643 3431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.648303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34072 (local address 127.23.229.62:37999)
0809 18:56:58.648454 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.648456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.651247 (+ 2791us) server_negotiation.cc:407] Connection header received
0809 18:56:58.651276 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.651277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.651292 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.651354 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.652339 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.653167 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.654287 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.654601 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.654672 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.657482 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.657484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.657484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.657491 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.660002 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.660348 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.660349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.660350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.660412 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.660931 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.660932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.660932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.661088 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.661203 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.661414 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.661516 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
I20260809 18:56:58.664692 3441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.651675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59164 (local address 127.23.229.60:46543)
0809 18:56:58.651805 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.651807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.652495 (+ 688us) server_negotiation.cc:407] Connection header received
0809 18:56:58.652527 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.652528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.652542 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.652601 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.653393 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.655432 (+ 2039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.659076 (+ 3644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.659281 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.659388 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.660813 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.660814 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.660815 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.660822 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.662615 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.663170 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.663172 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.663172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.663234 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.663964 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.663965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.663965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.664075 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.664187 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.664512 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.664601 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260809 18:56:58.665320 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.650899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36076 (local address 127.23.229.61:37757)
0809 18:56:58.656216 (+ 5317us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.656219 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.656228 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:58.656251 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.656252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.656263 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.656332 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.657008 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.657726 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.659948 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.660267 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.660346 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.662280 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.662281 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.662282 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.662288 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.663881 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.664260 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.664261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.664262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.664323 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.664592 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.664593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.664593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.664723 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.664820 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.665114 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.665218 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5299,"thread_start_us":311,"threads_started":1}
I20260809 18:56:58.663556 1348 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:58.665984 1348 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:58.666999 3192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: NON_VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: true } } }
I20260809 18:56:58.667121 3192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.668586 3192 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: attempting to promote NON_VOTER e77c98c907024b9e82f8f937005431a3 to VOTER
I20260809 18:56:58.668725 3192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:56:58.669189 2653 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 LEARNER]: Refusing update from remote peer 2f28714a43be4261a929bfa3fa746b0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 18:56:58.669243 2346 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Refusing update from remote peer 2f28714a43be4261a929bfa3fa746b0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 18:56:58.669520 3443 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 18:56:58.669617 3444 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 18:56:58.670383 3444 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e77c98c907024b9e82f8f937005431a3 (127.23.229.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.670511 2346 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e77c98c907024b9e82f8f937005431a3 (127.23.229.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.670702 2653 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e77c98c907024b9e82f8f937005431a3 (127.23.229.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.671722 2702 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.671803 2702 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:56:58.671725 3443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.671854 3443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.671926 3444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.671958 3444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.671952 3443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.672039 3443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.673352 3461 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f28714a43be4261a929bfa3fa746b0b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:56:58.673470 3461 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:56:58.676784 3225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.672311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:42087 (local address 127.0.0.1:43720)
0809 18:56:58.672362 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.672373 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.672424 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.672794 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.672795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.672798 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:58.672849 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.672851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.674267 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.674269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.675446 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.675449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.676535 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.676536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.676612 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.676616 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.676668 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.676711 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 18:56:58.677047 3462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.672414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43720 (local address 127.23.229.2:42087)
0809 18:56:58.672641 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.672646 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.672654 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:58.672688 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.672689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.672703 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.672798 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:58.672908 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.674052 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.675550 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.676278 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.676356 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.676441 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.676914 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.676962 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":150,"threads_started":1}
I20260809 18:56:58.677719 3465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.672931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42246 (local address 127.23.229.1:42237)
0809 18:56:58.673621 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.673626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.673643 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:56:58.673680 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.673681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.673695 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.673796 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:58.673953 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.675430 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.676735 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.677316 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.677423 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.677505 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.677605 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.677641 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":89,"threads_started":1}
I20260809 18:56:58.677733 3464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.672801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42237 (local address 127.0.0.1:42246)
0809 18:56:58.673141 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.673151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.673208 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.673794 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.673795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.673798 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:58.673845 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.673847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.675536 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.675537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.676664 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.676667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.677437 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.677439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.677509 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.677513 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.677591 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.677637 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":78,"threads_started":1}
I20260809 18:56:58.677922 3467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.672986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:38819 (local address 127.0.0.1:56942)
0809 18:56:58.673326 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.673337 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.673383 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.674134 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.674135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.674137 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:58.674179 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.674181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.675099 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.675100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.676079 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.676081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.677705 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.677706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.677769 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.677773 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.677808 (+ 35us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.677851 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":61,"threads_started":1}
I20260809 18:56:58.677855 3059 tablet_service.cc:1467] Processing CreateTablet for tablet 861567e34818453ebdd4b1b5be87fef6 (DEFAULT_TABLE table=test-table [id=ce59da2576e04503add4e2e7f5b71833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:58.678242 3059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861567e34818453ebdd4b1b5be87fef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:58.678634 3470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.673098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56942 (local address 127.23.229.3:38819)
0809 18:56:58.673941 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.673946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.673955 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:56:58.673993 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.673994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.674010 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.674259 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:58.674328 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.674998 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.676177 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.677613 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.678403 (+ 790us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.678488 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.678514 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.678557 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":799,"thread_start_us":109,"threads_started":1}
I20260809 18:56:58.678786 2824 tablet_service.cc:1467] Processing CreateTablet for tablet 861567e34818453ebdd4b1b5be87fef6 (DEFAULT_TABLE table=test-table [id=ce59da2576e04503add4e2e7f5b71833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:58.679141 2824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861567e34818453ebdd4b1b5be87fef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:58.679251 3298 tablet_service.cc:1467] Processing CreateTablet for tablet 861567e34818453ebdd4b1b5be87fef6 (DEFAULT_TABLE table=test-table [id=ce59da2576e04503add4e2e7f5b71833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:58.679566 3298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861567e34818453ebdd4b1b5be87fef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:58.682979 3472 tablet_bootstrap.cc:492] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Bootstrap starting.
I20260809 18:56:58.683293 3474 tablet_bootstrap.cc:492] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Bootstrap starting.
I20260809 18:56:58.683650 3472 tablet_bootstrap.cc:654] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:58.683912 3474 tablet_bootstrap.cc:654] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:58.683960 3472 log.cc:824] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:58.684273 3474 log.cc:824] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:58.684705 3471 tablet_bootstrap.cc:492] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Bootstrap starting.
I20260809 18:56:58.684877 3472 tablet_bootstrap.cc:492] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: No bootstrap required, opened a new log
I20260809 18:56:58.684985 3472 ts_tablet_manager.cc:1397] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:58.685165 3474 tablet_bootstrap.cc:492] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: No bootstrap required, opened a new log
I20260809 18:56:58.685232 3474 ts_tablet_manager.cc:1397] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:56:58.685389 3471 tablet_bootstrap.cc:654] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:58.685695 3471 log.cc:824] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:58.686412 3471 tablet_bootstrap.cc:492] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: No bootstrap required, opened a new log
I20260809 18:56:58.686499 3471 ts_tablet_manager.cc:1397] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:58.687727 3472 raft_consensus.cc:348] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.687829 3474 raft_consensus.cc:348] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.687917 3472 raft_consensus.cc:374] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:58.687955 3474 raft_consensus.cc:374] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:58.687956 3472 raft_consensus.cc:729] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbd68703549461ebc2dc5bbedcee8a1, State: Initialized, Role: FOLLOWER
I20260809 18:56:58.687996 3474 raft_consensus.cc:729] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e6c689f4c34713b5d9f237b3aa89ad, State: Initialized, Role: FOLLOWER
I20260809 18:56:58.688104 3474 consensus_queue.cc:260] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.688100 3472 consensus_queue.cc:260] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.688385 3472 ts_tablet_manager.cc:1428] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 18:56:58.688385 3474 ts_tablet_manager.cc:1428] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:56:58.688570 3410 heartbeater.cc:503] Master 127.23.229.62:37999 was elected leader, sending a full tablet report...
I20260809 18:56:58.688571 2937 heartbeater.cc:503] Master 127.23.229.62:37999 was elected leader, sending a full tablet report...
I20260809 18:56:58.690340 3471 raft_consensus.cc:348] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.690488 3471 raft_consensus.cc:374] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:58.690536 3471 raft_consensus.cc:729] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88d96d0c6573489282a0da1e316caa74, State: Initialized, Role: FOLLOWER
I20260809 18:56:58.690654 3471 consensus_queue.cc:260] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.690928 3471 ts_tablet_manager.cc:1428] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:56:58.690991 3178 heartbeater.cc:503] Master 127.23.229.62:37999 was elected leader, sending a full tablet report...
W20260809 18:56:58.731900 3180 tablet.cc:2369] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:56:58.793696 2939 tablet.cc:2369] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:58.825588 3482 raft_consensus.cc:482] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:58.825747 3482 raft_consensus.cc:504] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.826113 3482 leader_election.cc:288] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237), c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3:38819)
I20260809 18:56:58.829447 3470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.826572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:56309 (local address 127.23.229.3:38819)
0809 18:56:58.826631 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.826633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.826641 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:56:58.826669 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.826670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.826678 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.826759 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:58.826935 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.827469 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.828500 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.828926 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.829042 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.829054 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.829228 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.829303 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:56:58.829535 3184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.826483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:38819 (local address 127.23.229.2:56309)
0809 18:56:58.826533 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.826544 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.826589 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.826762 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.826763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.826765 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:58.826843 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.826844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.827566 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.827567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.828371 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.828373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.829064 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.829065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.829136 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.829139 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.829219 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.829266 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:56:58.829559 3186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.826340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42237 (local address 127.23.229.2:60793)
0809 18:56:58.826401 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:58.826412 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:58.826518 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:58.826687 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:58.826687 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:58.826689 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:58.826771 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.826772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.827486 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.827487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.828369 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:58.828372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.829152 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.829153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:58.829329 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.829334 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:58.829396 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:56:58.829441 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":3}
I20260809 18:56:58.829524 3465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.826413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:60793 (local address 127.23.229.1:42237)
0809 18:56:58.826481 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.826484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.826495 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:56:58.826585 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.826586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.826596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.826669 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:58.826841 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.827393 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.828470 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.829068 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.829155 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.829163 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.829412 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.829451 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:56:58.829932 3326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861567e34818453ebdd4b1b5be87fef6" candidate_uuid: "88d96d0c6573489282a0da1e316caa74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" is_pre_election: true
I20260809 18:56:58.829926 2862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861567e34818453ebdd4b1b5be87fef6" candidate_uuid: "88d96d0c6573489282a0da1e316caa74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" is_pre_election: true
I20260809 18:56:58.830098 3326 raft_consensus.cc:2454] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88d96d0c6573489282a0da1e316caa74 in term 0.
I20260809 18:56:58.830117 2862 raft_consensus.cc:2454] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88d96d0c6573489282a0da1e316caa74 in term 0.
I20260809 18:56:58.830325 2974 leader_election.cc:302] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88d96d0c6573489282a0da1e316caa74, fbbd68703549461ebc2dc5bbedcee8a1; no voters:
I20260809 18:56:58.830484 3482 raft_consensus.cc:2781] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:58.830576 3482 raft_consensus.cc:482] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:58.830614 3482 raft_consensus.cc:3037] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:58.831401 3482 raft_consensus.cc:504] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.831564 3482 leader_election.cc:288] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [CANDIDATE]: Term 1 election: Requested vote from peers fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237), c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3:38819)
I20260809 18:56:58.831801 2862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861567e34818453ebdd4b1b5be87fef6" candidate_uuid: "88d96d0c6573489282a0da1e316caa74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbd68703549461ebc2dc5bbedcee8a1"
I20260809 18:56:58.831828 3326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861567e34818453ebdd4b1b5be87fef6" candidate_uuid: "88d96d0c6573489282a0da1e316caa74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad"
I20260809 18:56:58.831907 2862 raft_consensus.cc:3037] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:58.831931 3326 raft_consensus.cc:3037] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:58.832922 3326 raft_consensus.cc:2454] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88d96d0c6573489282a0da1e316caa74 in term 1.
I20260809 18:56:58.832922 2862 raft_consensus.cc:2454] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88d96d0c6573489282a0da1e316caa74 in term 1.
I20260809 18:56:58.833105 2974 leader_election.cc:302] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88d96d0c6573489282a0da1e316caa74, fbbd68703549461ebc2dc5bbedcee8a1; no voters:
I20260809 18:56:58.833230 3482 raft_consensus.cc:2781] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:58.833415 3482 raft_consensus.cc:686] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 1 LEADER]: Becoming Leader. State: Replica: 88d96d0c6573489282a0da1e316caa74, State: Running, Role: LEADER
I20260809 18:56:58.833540 3482 consensus_queue.cc:237] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } }
I20260809 18:56:58.834609 1348 catalog_manager.cc:5495] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88d96d0c6573489282a0da1e316caa74 (127.23.229.2). New cstate: current_term: 1 leader_uuid: "88d96d0c6573489282a0da1e316caa74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:58.857151 3462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.854782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43726 (local address 127.23.229.2:42087)
0809 18:56:58.854828 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.854830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.854843 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:56:58.854886 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.854887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.854908 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.854978 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:58.855117 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.855618 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.856385 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.856652 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.856708 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.856835 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:58.856942 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:58.857011 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.857023 (+ 12us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.857043 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:56:58.859242 3326 raft_consensus.cc:1261] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 FOLLOWER]: Refusing update from remote peer 88d96d0c6573489282a0da1e316caa74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:58.859242 2862 raft_consensus.cc:1261] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 1 FOLLOWER]: Refusing update from remote peer 88d96d0c6573489282a0da1e316caa74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:58.859616 3484 consensus_queue.cc:1035] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:58.859766 3482 consensus_queue.cc:1035] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:58.862180 3490 mvcc.cc:205] Tried to move back new op lower bound from 7316692250044141568 to 7316692249942745088. Current Snapshot: MvccSnapshot[applied={T|T < 7316692250044141568}]
I20260809 18:56:58.863045 3492 mvcc.cc:205] Tried to move back new op lower bound from 7316692250044141568 to 7316692249942745088. Current Snapshot: MvccSnapshot[applied={T|T < 7316692250044141568}]
I20260809 18:56:58.864357 3495 mvcc.cc:205] Tried to move back new op lower bound from 7316692250044141568 to 7316692249942745088. Current Snapshot: MvccSnapshot[applied={T|T < 7316692250044141568}]
I20260809 18:56:58.866463 1349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:58.866559 1349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:58.868455 1349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f28714a43be4261a929bfa3fa746b0b: Sending DeleteTablet for 3 replicas of tablet 861567e34818453ebdd4b1b5be87fef6
I20260809 18:56:58.868854 3298 tablet_service.cc:1514] Processing DeleteTablet for tablet 861567e34818453ebdd4b1b5be87fef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:58 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:56942
I20260809 18:56:58.869141 3059 tablet_service.cc:1514] Processing DeleteTablet for tablet 861567e34818453ebdd4b1b5be87fef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:58 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:43720
I20260809 18:56:58.869164 2824 tablet_service.cc:1514] Processing DeleteTablet for tablet 861567e34818453ebdd4b1b5be87fef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:58 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:42246
I20260809 18:56:58.869365 3510 tablet_replica.cc:330] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: stopping tablet replica
I20260809 18:56:58.869470 3510 raft_consensus.cc:2229] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:58.869592 3510 raft_consensus.cc:2258] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:58.870028 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 1286
I20260809 18:56:58.870050 3507 tablet_replica.cc:330] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: stopping tablet replica
I20260809 18:56:58.870101 3510 ts_tablet_manager.cc:1905] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:58.871941 3510 ts_tablet_manager.cc:1918] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:58.872011 3510 log.cc:1196] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/861567e34818453ebdd4b1b5be87fef6
I20260809 18:56:58.872243 3510 ts_tablet_manager.cc:1939] T 861567e34818453ebdd4b1b5be87fef6 P fbbd68703549461ebc2dc5bbedcee8a1: Deleting consensus metadata
I20260809 18:56:58.880604 3513 tablet_replica.cc:330] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: stopping tablet replica
I20260809 18:56:58.880762 3513 raft_consensus.cc:2229] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:58.880875 3513 raft_consensus.cc:2258] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:58.881074 3507 raft_consensus.cc:2229] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:58.881222 3507 raft_consensus.cc:2258] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:58.881699 3507 ts_tablet_manager.cc:1905] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:58.881698 3513 ts_tablet_manager.cc:1905] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:58.883455 3507 ts_tablet_manager.cc:1918] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:58.883455 3513 ts_tablet_manager.cc:1918] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:58.883558 3513 log.cc:1196] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/861567e34818453ebdd4b1b5be87fef6
I20260809 18:56:58.883558 3507 log.cc:1196] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/861567e34818453ebdd4b1b5be87fef6
I20260809 18:56:58.883870 3507 ts_tablet_manager.cc:1939] T 861567e34818453ebdd4b1b5be87fef6 P c8e6c689f4c34713b5d9f237b3aa89ad: Deleting consensus metadata
I20260809 18:56:58.883870 3513 ts_tablet_manager.cc:1939] T 861567e34818453ebdd4b1b5be87fef6 P 88d96d0c6573489282a0da1e316caa74: Deleting consensus metadata
W20260809 18:56:58.890198 3220 connection.cc:535] server connection from 127.0.0.1:56942 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 18:56:58.890221 2746 connection.cc:535] server connection from 127.0.0.1:42246 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 18:56:58.890359 2972 connection.cc:535] server connection from 127.0.0.1:43720 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 18:56:58.900596 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.892371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36092 (local address 127.23.229.61:37757)
0809 18:56:58.892421 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.892423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.892549 (+ 126us) server_negotiation.cc:407] Connection header received
0809 18:56:58.892645 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.892646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.892658 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.892718 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.893772 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.894550 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.895472 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.895700 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.895763 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.897628 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.897630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.897631 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.897641 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.899325 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.899720 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.899721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.899722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.899786 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.900009 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.900010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.900010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.900138 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.900239 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.900377 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.900463 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:56:58.900983 3441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.892588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.23.229.60:46543)
0809 18:56:58.892635 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.892637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.892781 (+ 144us) server_negotiation.cc:407] Connection header received
0809 18:56:58.892853 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.892854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.892870 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.892915 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.893693 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.894250 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.895254 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.895601 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.895680 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.897963 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.897964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.897965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.897974 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.899597 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.900020 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.900021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.900022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.900093 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.900306 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.900307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.900307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.900444 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.900540 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.900778 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.900883 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:56:59.864924 3527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:59.864576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:33317)
0809 18:56:59.864759 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:59.864856 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":77,"threads_started":1}
W20260809 18:56:59.865156 3178 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:37999 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:56:59.864969 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:59.864594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:60489)
0809 18:56:59.864783 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:59.864908 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":83,"threads_started":1}
I20260809 18:56:59.865521 3530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:59.864973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:43723)
0809 18:56:59.865367 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:59.865474 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":55,"threads_started":1}
W20260809 18:56:59.865598 2937 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:37999 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
W20260809 18:56:59.865818 3410 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:37999 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:00.368597 3531 raft_consensus.cc:482] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f28714a43be4261a929bfa3fa746b0b)
I20260809 18:57:00.368753 3531 raft_consensus.cc:504] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:57:00.368799 3533 raft_consensus.cc:482] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f28714a43be4261a929bfa3fa746b0b)
I20260809 18:57:00.368975 3533 raft_consensus.cc:504] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:57:00.369113 3531 leader_election.cc:288] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999), e77c98c907024b9e82f8f937005431a3 (127.23.229.60:46543)
I20260809 18:57:00.369529 3534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.369284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34544)
0809 18:57:00.369422 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.369479 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":61,"threads_started":1}
I20260809 18:57:00.369624 3533 leader_election.cc:288] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999), e22763e4e9e84e63a134291acd8da39d (127.23.229.61:37757)
W20260809 18:57:00.369652 2303 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:00.369827 3537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.369409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34550)
0809 18:57:00.369736 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.369783 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":86,"threads_started":1}
W20260809 18:57:00.369931 2611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:00.370121 3534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.370020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34560)
0809 18:57:00.370067 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.370092 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 18:57:00.370200 2303 leader_election.cc:334] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999): Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:00.370338 3537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.370245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34576)
0809 18:57:00.370281 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.370305 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 18:57:00.370435 2611 leader_election.cc:334] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999): Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:00.372712 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.369540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36108 (local address 127.23.229.61:37757)
0809 18:57:00.369787 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.369789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.369799 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:00.369830 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.369831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.369844 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.370089 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:00.370128 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.370956 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.371914 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.372372 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.372429 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.372439 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.372631 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.372668 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":58,"threads_started":1}
I20260809 18:57:00.372753 3536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.369382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:37757 (local address 127.0.0.1:36108)
0809 18:57:00.369568 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.369581 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.369644 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.369943 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.369944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.369947 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:00.370021 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.370023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.371044 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.371046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.371814 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.371815 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.372462 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.372463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.372552 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.372557 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.372619 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.372663 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":61,"threads_started":1}
I20260809 18:57:00.373143 3541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.369549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:46543 (local address 127.0.0.1:59194)
0809 18:57:00.369810 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.369820 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.370043 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.370349 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.370349 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.370351 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:00.370387 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.370389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.371241 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.371242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.372114 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.372116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.372760 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.372761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.372926 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.372931 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.372984 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.373023 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":211,"threads_started":1}
I20260809 18:57:00.373041 2346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e77c98c907024b9e82f8f937005431a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e22763e4e9e84e63a134291acd8da39d" is_pre_election: true
I20260809 18:57:00.373212 3539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.369470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.23.229.60:46543)
0809 18:57:00.369726 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.369729 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.370015 (+ 286us) server_negotiation.cc:407] Connection header received
0809 18:57:00.370121 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.370122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.370131 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.370243 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:00.370462 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.371157 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.372204 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.372686 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.372747 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.372757 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.373089 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.373139 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":43,"threads_started":1}
I20260809 18:57:00.373255 2346 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e77c98c907024b9e82f8f937005431a3 in term 1.
I20260809 18:57:00.373413 2608 leader_election.cc:302] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e22763e4e9e84e63a134291acd8da39d, e77c98c907024b9e82f8f937005431a3; no voters: 2f28714a43be4261a929bfa3fa746b0b
I20260809 18:57:00.373410 2653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e22763e4e9e84e63a134291acd8da39d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e77c98c907024b9e82f8f937005431a3" is_pre_election: true
I20260809 18:57:00.373555 2653 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e22763e4e9e84e63a134291acd8da39d in term 1.
I20260809 18:57:00.373602 3533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 18:57:00.373680 3533 raft_consensus.cc:482] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f28714a43be4261a929bfa3fa746b0b)
I20260809 18:57:00.373709 3533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:57:00.373731 2302 leader_election.cc:302] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e22763e4e9e84e63a134291acd8da39d, e77c98c907024b9e82f8f937005431a3; no voters: 2f28714a43be4261a929bfa3fa746b0b
I20260809 18:57:00.373879 3531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 18:57:00.373937 3531 raft_consensus.cc:482] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f28714a43be4261a929bfa3fa746b0b)
I20260809 18:57:00.373971 3531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:57:00.374643 3531 raft_consensus.cc:504] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:57:00.374689 3533 raft_consensus.cc:504] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:57:00.374797 3531 leader_election.cc:288] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [CANDIDATE]: Term 2 election: Requested vote from peers 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999), e77c98c907024b9e82f8f937005431a3 (127.23.229.60:46543)
I20260809 18:57:00.374820 3533 leader_election.cc:288] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 2 election: Requested vote from peers 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999), e22763e4e9e84e63a134291acd8da39d (127.23.229.61:37757)
I20260809 18:57:00.375031 3536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.374940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34588)
0809 18:57:00.374976 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.375000 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260809 18:57:00.375241 3541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.375073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34590)
0809 18:57:00.375184 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.375211 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 18:57:00.375398 3536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.375296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34592)
0809 18:57:00.375342 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.375368 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 18:57:00.375419 2653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e22763e4e9e84e63a134291acd8da39d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e77c98c907024b9e82f8f937005431a3"
I20260809 18:57:00.375399 2346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e77c98c907024b9e82f8f937005431a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e22763e4e9e84e63a134291acd8da39d"
I20260809 18:57:00.375506 2346 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e77c98c907024b9e82f8f937005431a3 in current term 2: Already voted for candidate e22763e4e9e84e63a134291acd8da39d in this term.
W20260809 18:57:00.375494 2611 leader_election.cc:334] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999): Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:00.375494 2653 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e22763e4e9e84e63a134291acd8da39d in current term 2: Already voted for candidate e77c98c907024b9e82f8f937005431a3 in this term.
I20260809 18:57:00.375669 2608 leader_election.cc:302] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e77c98c907024b9e82f8f937005431a3; no voters: 2f28714a43be4261a929bfa3fa746b0b, e22763e4e9e84e63a134291acd8da39d
I20260809 18:57:00.375845 3533 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 18:57:00.375910 3541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.375805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34600)
0809 18:57:00.375843 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.375868 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 18:57:00.375979 2303 leader_election.cc:334] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999): Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:00.376024 2303 leader_election.cc:302] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e22763e4e9e84e63a134291acd8da39d; no voters: 2f28714a43be4261a929bfa3fa746b0b, e77c98c907024b9e82f8f937005431a3
I20260809 18:57:00.376104 3531 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 18:57:00.865832 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.865535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:58413)
0809 18:57:00.865721 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.865767 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":103,"threads_started":1}
I20260809 18:57:00.866175 3549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.865874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:51715)
0809 18:57:00.866074 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.866131 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":85,"threads_started":1}
I20260809 18:57:00.866321 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.866131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:36283)
0809 18:57:00.866245 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.866281 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260809 18:57:01.866590 3551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.866311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:44079)
0809 18:57:01.866438 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.866485 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260809 18:57:01.866781 3552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.866557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:54439)
0809 18:57:01.866670 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.866728 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":59,"threads_started":1}
I20260809 18:57:01.866983 3555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.866687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:34815)
0809 18:57:01.866893 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.866932 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":62,"threads_started":1}
I20260809 18:57:02.242347 3557 raft_consensus.cc:482] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:02.242468 3557 raft_consensus.cc:504] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:57:02.242691 3557 leader_election.cc:288] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999), e22763e4e9e84e63a134291acd8da39d (127.23.229.61:37757)
I20260809 18:57:02.242998 2346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e77c98c907024b9e82f8f937005431a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e22763e4e9e84e63a134291acd8da39d" is_pre_election: true
I20260809 18:57:02.243098 2346 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e77c98c907024b9e82f8f937005431a3 in term 2.
I20260809 18:57:02.243101 3558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.242875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34880)
0809 18:57:02.242994 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.243039 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":76,"threads_started":1}
I20260809 18:57:02.243274 2608 leader_election.cc:302] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e22763e4e9e84e63a134291acd8da39d, e77c98c907024b9e82f8f937005431a3; no voters:
I20260809 18:57:02.243388 3557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 18:57:02.243449 3557 raft_consensus.cc:482] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:02.243466 3557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 2 FOLLOWER]: Advancing to term 3
I20260809 18:57:02.243640 3558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.243527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34896)
0809 18:57:02.243575 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.243608 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260809 18:57:02.243743 2611 leader_election.cc:334] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999): Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:02.244395 3557 raft_consensus.cc:504] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:57:02.244691 3557 leader_election.cc:288] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 3 election: Requested vote from peers 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999), e22763e4e9e84e63a134291acd8da39d (127.23.229.61:37757)
I20260809 18:57:02.244773 3558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.244644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34912)
0809 18:57:02.244706 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.244741 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 18:57:02.244891 2346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e77c98c907024b9e82f8f937005431a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e22763e4e9e84e63a134291acd8da39d"
I20260809 18:57:02.245009 2346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 2 FOLLOWER]: Advancing to term 3
I20260809 18:57:02.245153 3558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.245075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34916)
0809 18:57:02.245106 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.245133 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260809 18:57:02.245232 2611 leader_election.cc:334] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999): Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
I20260809 18:57:02.245823 2346 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e77c98c907024b9e82f8f937005431a3 in term 3.
I20260809 18:57:02.246009 2608 leader_election.cc:302] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e22763e4e9e84e63a134291acd8da39d, e77c98c907024b9e82f8f937005431a3; no voters: 2f28714a43be4261a929bfa3fa746b0b
I20260809 18:57:02.246170 3557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 18:57:02.246338 3557 raft_consensus.cc:686] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [term 3 LEADER]: Becoming Leader. State: Replica: e77c98c907024b9e82f8f937005431a3, State: Running, Role: LEADER
I20260809 18:57:02.246444 3557 consensus_queue.cc:237] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } }
I20260809 18:57:02.246881 3560 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e77c98c907024b9e82f8f937005431a3. Latest consensus state: current_term: 3 leader_uuid: "e77c98c907024b9e82f8f937005431a3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:57:02.246985 3560 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:02.247164 3562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:02.247563 3562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:02.247620 3562 catalog_manager.cc:1259] Loaded cluster ID: 2625554564554dc1b8f2725e1ac39bad
I20260809 18:57:02.247635 3562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:02.247783 3562 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:02.247836 3562 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Loaded TSK: 0
I20260809 18:57:02.247932 3562 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:57:02.311439 2632 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:02.313257 2632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:02.314455 3558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.314314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34932)
0809 18:57:02.314377 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.314424 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:57:02.314498 2346 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [term 3 FOLLOWER]: Refusing update from remote peer e77c98c907024b9e82f8f937005431a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 18:57:02.314845 3558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.314731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.0.0.1:34942)
0809 18:57:02.314766 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.314796 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260809 18:57:02.314795 3560 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 18:57:02.314965 2611 consensus_peers.cc:487] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 -> Peer 2f28714a43be4261a929bfa3fa746b0b (127.23.229.62:37999): Couldn't send request to peer 2f28714a43be4261a929bfa3fa746b0b. Status: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 18:57:02.315536 3566 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e77c98c907024b9e82f8f937005431a3. Latest consensus state: current_term: 3 leader_uuid: "e77c98c907024b9e82f8f937005431a3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:57:02.315654 3566 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:02.316097 3560 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "e77c98c907024b9e82f8f937005431a3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:57:02.316177 3560 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:02.316287 3566 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "e77c98c907024b9e82f8f937005431a3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2f28714a43be4261a929bfa3fa746b0b" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37999 } } peers { permanent_uuid: "e22763e4e9e84e63a134291acd8da39d" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 37757 } attrs { promote: false } } peers { permanent_uuid: "e77c98c907024b9e82f8f937005431a3" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 46543 } attrs { promote: false } } }
I20260809 18:57:02.316373 3566 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22763e4e9e84e63a134291acd8da39d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:02.321645 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.318426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:42087 (local address 127.0.0.1:43740)
0809 18:57:02.318688 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.318699 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.318756 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.318977 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.318978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.318981 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:02.319041 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.319043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.319714 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.319715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.320600 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.320602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.321392 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.321393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.321458 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.321462 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.321510 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.321551 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":43,"thread_start_us":81,"threads_started":1}
I20260809 18:57:02.321867 3558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.318401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42237 (local address 127.0.0.1:42248)
0809 18:57:02.318536 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.318558 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.318621 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.319004 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.319005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.319007 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:02.319064 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.319066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.319747 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.319748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.320963 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.320965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.321630 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.321631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.321697 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.321701 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.321757 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.321804 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":1}
I20260809 18:57:02.321923 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.318537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43740 (local address 127.23.229.2:42087)
0809 18:57:02.318682 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.318684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.318743 (+ 59us) server_negotiation.cc:407] Connection header received
0809 18:57:02.318813 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.318814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.318826 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.318916 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:02.319121 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.319625 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.320689 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.321257 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.321331 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.321344 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.321795 (+ 451us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.321843 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260809 18:57:02.322180 3059 tablet_service.cc:1467] Processing CreateTablet for tablet 92168cc813bd4ba88097cc562ae44cc9 (DEFAULT_TABLE table=test-table [id=34fe3267c9d341d48969c215cf162d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:02.322270 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.318683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42248 (local address 127.23.229.1:42237)
0809 18:57:02.318856 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.318858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.318867 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:57:02.318895 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.318896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.318908 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.319127 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:02.319175 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.319646 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.321030 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.321534 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.321628 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.321641 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.322137 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.322193 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":64,"threads_started":1}
I20260809 18:57:02.322333 3059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92168cc813bd4ba88097cc562ae44cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:02.322888 3579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.318497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:38819 (local address 127.0.0.1:56948)
0809 18:57:02.318904 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.318915 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.318963 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.319965 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.319967 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.319969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:02.320004 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.320006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.320952 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.320953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.322015 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.322018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.322708 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.322709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.322757 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.322760 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.322811 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.322841 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":67,"threads_started":1}
I20260809 18:57:02.322943 3586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.318717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56948 (local address 127.23.229.3:38819)
0809 18:57:02.319794 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.319796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.319805 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:57:02.319834 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.319835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.319847 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.319919 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:02.320097 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.320868 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.322086 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.322618 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.322696 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.322708 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.322827 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.322865 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1053,"thread_start_us":70,"threads_started":1}
I20260809 18:57:02.323205 3298 tablet_service.cc:1467] Processing CreateTablet for tablet 92168cc813bd4ba88097cc562ae44cc9 (DEFAULT_TABLE table=test-table [id=34fe3267c9d341d48969c215cf162d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:02.323335 3298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92168cc813bd4ba88097cc562ae44cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:02.323930 3587 tablet_bootstrap.cc:492] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: Bootstrap starting.
I20260809 18:57:02.324335 3587 tablet_bootstrap.cc:654] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:02.324596 2824 tablet_service.cc:1467] Processing CreateTablet for tablet 92168cc813bd4ba88097cc562ae44cc9 (DEFAULT_TABLE table=test-table [id=34fe3267c9d341d48969c215cf162d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:02.324759 2824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92168cc813bd4ba88097cc562ae44cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:02.324842 3591 tablet_bootstrap.cc:492] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Bootstrap starting.
I20260809 18:57:02.325240 3591 tablet_bootstrap.cc:654] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:02.325832 3591 tablet_bootstrap.cc:492] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: No bootstrap required, opened a new log
I20260809 18:57:02.325889 3591 ts_tablet_manager.cc:1397] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:02.326002 3591 raft_consensus.cc:348] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.326118 3591 raft_consensus.cc:374] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:02.326145 3591 raft_consensus.cc:729] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e6c689f4c34713b5d9f237b3aa89ad, State: Initialized, Role: FOLLOWER
I20260809 18:57:02.326210 3591 consensus_queue.cc:260] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.326436 3591 ts_tablet_manager.cc:1428] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:02.326442 3596 tablet_bootstrap.cc:492] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1: Bootstrap starting.
I20260809 18:57:02.326833 3596 tablet_bootstrap.cc:654] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:02.326972 3555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.326864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:33569)
0809 18:57:02.326909 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.326937 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 18:57:02.327162 3587 tablet_bootstrap.cc:492] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: No bootstrap required, opened a new log
I20260809 18:57:02.327229 3587 ts_tablet_manager.cc:1397] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 18:57:02.327355 3587 raft_consensus.cc:348] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.327440 3587 raft_consensus.cc:374] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:02.327450 3555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.327338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:42405)
0809 18:57:02.327392 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.327426 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 18:57:02.327467 3587 raft_consensus.cc:729] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88d96d0c6573489282a0da1e316caa74, State: Initialized, Role: FOLLOWER
I20260809 18:57:02.327517 3587 consensus_queue.cc:260] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.327582 3409 heartbeater.cc:503] Master 127.23.229.60:46543 was elected leader, sending a full tablet report...
I20260809 18:57:02.327773 3587 ts_tablet_manager.cc:1428] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:02.328127 3551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.328027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:39693)
0809 18:57:02.328070 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.328096 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 18:57:02.328158 3596 tablet_bootstrap.cc:492] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1: No bootstrap required, opened a new log
I20260809 18:57:02.328203 3596 ts_tablet_manager.cc:1397] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:57:02.328413 3596 raft_consensus.cc:348] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.328526 3596 raft_consensus.cc:374] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:02.328557 3596 raft_consensus.cc:729] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbd68703549461ebc2dc5bbedcee8a1, State: Initialized, Role: FOLLOWER
I20260809 18:57:02.328603 3596 consensus_queue.cc:260] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.328806 3596 ts_tablet_manager.cc:1428] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 18:57:02.329108 3552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.329007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:55883)
0809 18:57:02.329045 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.329078 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260809 18:57:02.329155 3177 heartbeater.cc:503] Master 127.23.229.60:46543 was elected leader, sending a full tablet report...
I20260809 18:57:02.329437 2936 heartbeater.cc:503] Master 127.23.229.60:46543 was elected leader, sending a full tablet report...
I20260809 18:57:02.329499 3551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.329286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:37235)
0809 18:57:02.329446 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.329474 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
I20260809 18:57:02.329649 3552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.329383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:37989)
0809 18:57:02.329600 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.329626 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199}
W20260809 18:57:02.394848 3413 tablet.cc:2369] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:57:02.503927 3597 raft_consensus.cc:482] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:02.504045 3597 raft_consensus.cc:504] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.504519 3597 leader_election.cc:288] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237), 88d96d0c6573489282a0da1e316caa74 (127.23.229.2:42087)
I20260809 18:57:02.508702 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.504861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:50851 (local address 127.23.229.1:42237)
0809 18:57:02.504906 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.504908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.505102 (+ 194us) server_negotiation.cc:407] Connection header received
0809 18:57:02.505132 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.505133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.505141 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.505221 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:02.505367 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.506070 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.507651 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.508216 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.508300 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.508311 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.508578 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.508624 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:57:02.508702 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.504816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:58305 (local address 127.23.229.2:42087)
0809 18:57:02.504869 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.504872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.504883 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:57:02.504920 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.504921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.504931 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.505003 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:02.505213 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.506013 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.507652 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.508216 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.508300 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.508311 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.508587 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.508628 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:57:02.508742 3602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.504719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42237 (local address 127.23.229.3:50851)
0809 18:57:02.505012 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.505022 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.505076 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.505248 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.505249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.505250 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:02.505292 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.505293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.506151 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.506152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.507543 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.507547 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.508373 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.508374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.508442 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.508445 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.508568 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.508625 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":124,"thread_start_us":154,"threads_started":1}
I20260809 18:57:02.508885 3555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.504719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:42087 (local address 127.23.229.3:58305)
0809 18:57:02.504769 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.504782 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.504837 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.505034 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.505036 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.505039 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:02.505125 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.505128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.506126 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.506127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.507543 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.507547 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.508336 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.508338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.508432 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.508437 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.508575 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.508625 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":84}
I20260809 18:57:02.509063 2862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92168cc813bd4ba88097cc562ae44cc9" candidate_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" is_pre_election: true
I20260809 18:57:02.509192 2862 raft_consensus.cc:2454] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e6c689f4c34713b5d9f237b3aa89ad in term 0.
I20260809 18:57:02.509192 3093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92168cc813bd4ba88097cc562ae44cc9" candidate_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88d96d0c6573489282a0da1e316caa74" is_pre_election: true
I20260809 18:57:02.509349 3093 raft_consensus.cc:2454] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e6c689f4c34713b5d9f237b3aa89ad in term 0.
I20260809 18:57:02.509407 3222 leader_election.cc:302] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e6c689f4c34713b5d9f237b3aa89ad, fbbd68703549461ebc2dc5bbedcee8a1; no voters:
I20260809 18:57:02.509550 3597 raft_consensus.cc:2781] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:02.509598 3597 raft_consensus.cc:482] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:02.509614 3597 raft_consensus.cc:3037] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:02.510382 3597 raft_consensus.cc:504] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.510540 3597 leader_election.cc:288] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [CANDIDATE]: Term 1 election: Requested vote from peers fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237), 88d96d0c6573489282a0da1e316caa74 (127.23.229.2:42087)
I20260809 18:57:02.510715 3093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92168cc813bd4ba88097cc562ae44cc9" candidate_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88d96d0c6573489282a0da1e316caa74"
I20260809 18:57:02.510697 2862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92168cc813bd4ba88097cc562ae44cc9" candidate_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbd68703549461ebc2dc5bbedcee8a1"
I20260809 18:57:02.510814 2862 raft_consensus.cc:3037] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:02.510814 3093 raft_consensus.cc:3037] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:02.511476 2862 raft_consensus.cc:2454] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e6c689f4c34713b5d9f237b3aa89ad in term 1.
I20260809 18:57:02.511564 3093 raft_consensus.cc:2454] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e6c689f4c34713b5d9f237b3aa89ad in term 1.
I20260809 18:57:02.511696 3222 leader_election.cc:302] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e6c689f4c34713b5d9f237b3aa89ad, fbbd68703549461ebc2dc5bbedcee8a1; no voters:
I20260809 18:57:02.511826 3597 raft_consensus.cc:2781] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:02.512036 3597 raft_consensus.cc:686] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 LEADER]: Becoming Leader. State: Replica: c8e6c689f4c34713b5d9f237b3aa89ad, State: Running, Role: LEADER
I20260809 18:57:02.512128 3597 consensus_queue.cc:237] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } }
I20260809 18:57:02.512570 3555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.512390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:33295)
0809 18:57:02.512449 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.512517 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:57:02.513000 2628 catalog_manager.cc:5495] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3). New cstate: current_term: 1 leader_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e6c689f4c34713b5d9f237b3aa89ad" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:02.550251 3586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.547878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56956 (local address 127.23.229.3:38819)
0809 18:57:02.547964 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.547966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.547974 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:02.548016 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.548017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.548036 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.548108 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:02.548245 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.548805 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.549534 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.549733 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.549787 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.549947 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:02.550059 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:02.550116 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.550168 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.550188 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:57:02.551645 2862 raft_consensus.cc:1261] T 92168cc813bd4ba88097cc562ae44cc9 P fbbd68703549461ebc2dc5bbedcee8a1 [term 1 FOLLOWER]: Refusing update from remote peer c8e6c689f4c34713b5d9f237b3aa89ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:02.551659 3093 raft_consensus.cc:1261] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 1 FOLLOWER]: Refusing update from remote peer c8e6c689f4c34713b5d9f237b3aa89ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:02.552083 3604 consensus_queue.cc:1035] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "88d96d0c6573489282a0da1e316caa74" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:02.552244 3597 consensus_queue.cc:1035] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbd68703549461ebc2dc5bbedcee8a1" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:02.553259 3552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.553147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:44771)
0809 18:57:02.553192 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.553224 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 18:57:02.553596 3551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.553480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:56195)
0809 18:57:02.553525 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.553565 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 18:57:02.554603 3555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.554497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:60111)
0809 18:57:02.554537 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.554569 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 18:57:02.554808 3551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.554708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.2:49475)
0809 18:57:02.554746 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.554779 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 18:57:02.555147 3555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.554882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.3:34489)
0809 18:57:02.555085 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.555116 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
I20260809 18:57:02.555379 3552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.555235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:37999 (local address 127.23.229.1:38993)
0809 18:57:02.555322 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.555349 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:37999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 18:57:02.557673 2632 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:02.557776 2632 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:02.559172 2632 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e77c98c907024b9e82f8f937005431a3: Sending DeleteTablet for 3 replicas of tablet 92168cc813bd4ba88097cc562ae44cc9
I20260809 18:57:02.559480 3059 tablet_service.cc:1514] Processing DeleteTablet for tablet 92168cc813bd4ba88097cc562ae44cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:02 UTC) from {username='oryx', principal='oryx/127.23.229.60@KRBTEST.COM'} at 127.0.0.1:43740
I20260809 18:57:02.559543 3298 tablet_service.cc:1514] Processing DeleteTablet for tablet 92168cc813bd4ba88097cc562ae44cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:02 UTC) from {username='oryx', principal='oryx/127.23.229.60@KRBTEST.COM'} at 127.0.0.1:56948
I20260809 18:57:02.559700 2824 tablet_service.cc:1514] Processing DeleteTablet for tablet 92168cc813bd4ba88097cc562ae44cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:02 UTC) from {username='oryx', principal='oryx/127.23.229.60@KRBTEST.COM'} at 127.0.0.1:42248
I20260809 18:57:02.559746 3622 tablet_replica.cc:330] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: stopping tablet replica
I20260809 18:57:02.559891 3622 raft_consensus.cc:2229] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:02.559928 3621 tablet_replica.cc:330] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: stopping tablet replica
I20260809 18:57:02.559990 3621 raft_consensus.cc:2229] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:02.560058 3621 raft_consensus.cc:2258] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:02.560117 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 2724
I20260809 18:57:02.563344 3621 ts_tablet_manager.cc:1905] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:02.565510 3621 ts_tablet_manager.cc:1918] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:02.565582 3621 log.cc:1196] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/92168cc813bd4ba88097cc562ae44cc9
I20260809 18:57:02.565840 3621 ts_tablet_manager.cc:1939] T 92168cc813bd4ba88097cc562ae44cc9 P 88d96d0c6573489282a0da1e316caa74: Deleting consensus metadata
I20260809 18:57:02.567329 2602 catalog_manager.cc:4841] TS 88d96d0c6573489282a0da1e316caa74 (127.23.229.2:42087): tablet 92168cc813bd4ba88097cc562ae44cc9 (table test-table [id=34fe3267c9d341d48969c215cf162d9d]) successfully deleted
I20260809 18:57:02.569267 3622 raft_consensus.cc:2258] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:02.570760 3622 ts_tablet_manager.cc:1905] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:02.573339 3622 ts_tablet_manager.cc:1918] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:02.573501 3622 log.cc:1196] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/92168cc813bd4ba88097cc562ae44cc9
I20260809 18:57:02.573925 3622 ts_tablet_manager.cc:1939] T 92168cc813bd4ba88097cc562ae44cc9 P c8e6c689f4c34713b5d9f237b3aa89ad: Deleting consensus metadata
I20260809 18:57:02.574463 2608 catalog_manager.cc:4841] TS c8e6c689f4c34713b5d9f237b3aa89ad (127.23.229.3:38819): tablet 92168cc813bd4ba88097cc562ae44cc9 (table test-table [id=34fe3267c9d341d48969c215cf162d9d]) successfully deleted
I20260809 18:57:02.585391 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 2950
I20260809 18:57:02.585377 3579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.585195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42237 (local address 127.0.0.1:42258)
0809 18:57:02.585267 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.585318 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 18:57:02.591923 2608 catalog_manager.cc:4584] TS fbbd68703549461ebc2dc5bbedcee8a1 (127.23.229.1:42237): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 92168cc813bd4ba88097cc562ae44cc9: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42237: connect: Connection refused (error 111)
I20260809 18:57:02.597275 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 3187
I20260809 18:57:02.612968 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 2087
I20260809 18:57:02.630061 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 2415
2026-08-09T18:57:02Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7165 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:02 dist-test-slave-jq4t krb5kdc[3630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:02 dist-test-slave-jq4t krb5kdc[3630](info): set up 2 sockets
Aug 09 18:57:02 dist-test-slave-jq4t krb5kdc[3630](info): commencing operation
krb5kdc: starting...
W20260809 18:57:04.293743 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.636s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:57:04 dist-test-slave-jq4t krb5kdc[3630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:04Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab.
Entry for principal oryx/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab.
I20260809 18:57:04.487975 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38501
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab
--principal=oryx/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:38501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:04.641552 3648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:04.642023 3648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:04.642071 3648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:04.644253 3648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:04.644302 3648 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:57:04.644316 3648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:04.644330 3648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:04.644421 3648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:04.644521 3648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:04.647300 3648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:38501
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.62.keytab
--principal=oryx/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:04.647807 3648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:04.648233 3648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:04.656915 3657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:04.656932 3661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:04.656910 3659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:04.657490 3648 server_base.cc:1034] running on GCE node
I20260809 18:57:04.658054 3648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:04.658651 3648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:04.659912 3648 hybrid_clock.cc:648] HybridClock initialized: now 1786301824659882 us; error 48 us; skew 500 ppm
Aug 09 18:57:04 dist-test-slave-jq4t krb5kdc[3630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301824, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:04.665241 3648 init.cc:377] Logged in from keytab as oryx/127.23.229.62@KRBTEST.COM (short username oryx)
I20260809 18:57:04.666127 3648 webserver.cc:460] Webserver started at http://127.23.229.62:33545/ using document root <none> and password file <none>
I20260809 18:57:04.666558 3648 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:04.666671 3648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:04.666895 3648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:04.668973 3648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e"
format_stamp: "Formatted at 2026-08-09 18:57:04 on dist-test-slave-jq4t"
server_key: "36e3d61e7d2f0b9bf0d61b1abf997ba2"
server_key_iv: "0e1a67f971339bd069f55f08ce297606"
server_key_version: "encryptionkey@0"
I20260809 18:57:04.669706 3648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e"
format_stamp: "Formatted at 2026-08-09 18:57:04 on dist-test-slave-jq4t"
server_key: "36e3d61e7d2f0b9bf0d61b1abf997ba2"
server_key_iv: "0e1a67f971339bd069f55f08ce297606"
server_key_version: "encryptionkey@0"
I20260809 18:57:04.672714 3648 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 18:57:04.674075 3675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:04.674439 3648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:04.674649 3648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e"
format_stamp: "Formatted at 2026-08-09 18:57:04 on dist-test-slave-jq4t"
server_key: "36e3d61e7d2f0b9bf0d61b1abf997ba2"
server_key_iv: "0e1a67f971339bd069f55f08ce297606"
server_key_version: "encryptionkey@0"
I20260809 18:57:04.674762 3648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:04.686609 3648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:04.690116 3648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:04.690351 3648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:04.699398 3648 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:38501
I20260809 18:57:04.699548 3789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:38501 every 8 connection(s)
I20260809 18:57:04.700157 3648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:04.701587 3790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:04.706110 3790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Bootstrap starting.
I20260809 18:57:04.707433 3790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:04.708010 3790 log.cc:824] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:04.708842 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 3648
I20260809 18:57:04.709030 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:57:04.709481 24468 external_mini_cluster.cc:1428] Setting key 1cc9fc34570521b1dafc313095b35188
I20260809 18:57:04.709575 3790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: No bootstrap required, opened a new log
I20260809 18:57:04.714003 3790 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38501 } }
I20260809 18:57:04.714321 3790 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:04.714370 3790 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f37ec3bb3c0467eb30d5ec2e7a2ee6e, State: Initialized, Role: FOLLOWER
I20260809 18:57:04.714639 3790 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38501 } }
I20260809 18:57:04.714756 3790 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:04.714826 3790 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:04.714954 3790 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:04.716039 3790 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38501 } }
I20260809 18:57:04.716248 3790 leader_election.cc:302] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f37ec3bb3c0467eb30d5ec2e7a2ee6e; no voters:
I20260809 18:57:04.716697 3800 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:04.717108 3800 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [term 1 LEADER]: Becoming Leader. State: Replica: 0f37ec3bb3c0467eb30d5ec2e7a2ee6e, State: Running, Role: LEADER
I20260809 18:57:04.717285 3800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38501 } }
I20260809 18:57:04.716698 3790 leader_election.cc:288] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:04.717943 3801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f37ec3bb3c0467eb30d5ec2e7a2ee6e. Latest consensus state: current_term: 1 leader_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38501 } } }
I20260809 18:57:04.718091 3801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:04.718222 3790 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:04.718335 3801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37ec3bb3c0467eb30d5ec2e7a2ee6e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38501 } } }
I20260809 18:57:04.718454 3801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:04.720062 3804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:04.721381 3804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:57:04 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:57:04.725854 3804 catalog_manager.cc:1347] Generated new cluster ID: 817bae81fc134dcfb81e5aa3e2861aca
I20260809 18:57:04.725970 3804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:04.730096 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:04.710355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.23.229.62:38501)
0809 18:57:04.710686 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:04.710708 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.710780 (+ 72us) server_negotiation.cc:407] Connection header received
0809 18:57:04.711834 (+ 1054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.711843 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.711936 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.712209 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:04.713553 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.715469 (+ 1916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.716919 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.717831 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.718068 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.723581 (+ 5513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:04.723594 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:04.723595 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:04.723611 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:04.726993 (+ 3382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.727908 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.727913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.727913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.728076 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.728430 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.728430 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.728431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.728903 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:04.729251 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.729411 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.729814 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":142,"threads_started":1}
I20260809 18:57:04.787747 3804 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:04.788851 3804 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:04.803121 3804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Generated new TSK 0
I20260809 18:57:04.803556 3804 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab.
Entry for principal oryx/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab.
I20260809 18:57:04.852543 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38501
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab
--principal=oryx/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:05.061311 3831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:05.061789 3831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:05.062007 3831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:05.064116 3831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:05.064232 3831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:05.064318 3831 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:57:05.064416 3831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:57:05.067184 3831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab
--principal=oryx/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:38501
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:05.067762 3831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:05.068250 3831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:05.077551 3840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:05.077404 3843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:05.077404 3839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:05.078014 3831 server_base.cc:1034] running on GCE node
I20260809 18:57:05.078426 3831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:05.078907 3831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:05.080112 3831 hybrid_clock.cc:648] HybridClock initialized: now 1786301825080116 us; error 66 us; skew 500 ppm
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:05.085567 3831 init.cc:377] Logged in from keytab as oryx/127.23.229.1@KRBTEST.COM (short username oryx)
I20260809 18:57:05.086467 3831 webserver.cc:460] Webserver started at http://127.23.229.1:37997/ using document root <none> and password file <none>
I20260809 18:57:05.086948 3831 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:05.087078 3831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:05.087332 3831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:05.089357 3831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "03022ffc82054a638339865ef916520b"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "824b21d6a97d163aa2d236920bca116f"
server_key_iv: "2d0334cd8fe6d3c985b2510dcdf56005"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.090073 3831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "03022ffc82054a638339865ef916520b"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "824b21d6a97d163aa2d236920bca116f"
server_key_iv: "2d0334cd8fe6d3c985b2510dcdf56005"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.092927 3831 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:05.094282 3861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:05.094583 3831 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:05.094767 3831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "03022ffc82054a638339865ef916520b"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "824b21d6a97d163aa2d236920bca116f"
server_key_iv: "2d0334cd8fe6d3c985b2510dcdf56005"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.094910 3831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:05.116580 3831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:05.120710 3831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:05.121033 3831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:05.122242 3831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:05.122344 3831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:05.122427 3831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:05.122505 3831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:57:05.137059 3831 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:43653
I20260809 18:57:05.137279 4073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:43653 every 8 connection(s)
I20260809 18:57:05.137959 3831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:05.141276 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 3831
I20260809 18:57:05.141505 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:05.141999 24468 external_mini_cluster.cc:1428] Setting key a8610bfc83573c1088f81cb821e03b45
I20260809 18:57:05.142313 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.122840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:40153 (local address 127.23.229.62:38501)
0809 18:57:05.122946 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.122950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.123388 (+ 438us) server_negotiation.cc:407] Connection header received
0809 18:57:05.124384 (+ 996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.124386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.124414 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.124596 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.125803 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.126811 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.128527 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.129062 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.129176 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.136222 (+ 7046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.136225 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.136226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.136251 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.139392 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.140225 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.140226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.140227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.140329 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.140843 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.140844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.140845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.141204 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.141348 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.141954 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.142143 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:57:05.142680 3875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.122858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38501 (local address 127.23.229.1:40153)
0809 18:57:05.123148 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.123243 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.124184 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.124799 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.124803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.125236 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:05.125585 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.125598 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.126901 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.126902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.128310 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.128313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.129264 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.129277 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.129682 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.131010 (+ 1328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:05.131071 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:05.135985 (+ 4914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:05.139569 (+ 3584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.139577 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.139581 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.140133 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.140514 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.140515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.140515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.140707 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.141355 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:05.141361 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:05.141701 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.141864 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.142155 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":148,"threads_started":1}
I20260809 18:57:05.143574 4080 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38501
I20260809 18:57:05.143747 4080 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:05.144150 4080 heartbeater.cc:511] Master 127.23.229.62:38501 requested a full tablet report, sending...
I20260809 18:57:05.145356 3715 ts_manager.cc:194] Registered new tserver with Master: 03022ffc82054a638339865ef916520b (127.23.229.1:43653)
I20260809 18:57:05.146699 3715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:40153
I20260809 18:57:05.155892 4088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.145677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38501 (local address 127.23.229.1:34175)
0809 18:57:05.145954 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.145976 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.146042 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.146360 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.146361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.146839 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:05.146990 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.146993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.148132 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.148134 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.149061 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.149064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.149711 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.149712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.149842 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.150620 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:05.150632 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:05.151172 (+ 540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:05.154022 (+ 2850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.154023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.154024 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.154360 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.154733 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.154734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.154734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.154846 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.155320 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:05.155321 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:05.155410 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.155596 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.155783 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":134,"threads_started":1}
I20260809 18:57:05.155890 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.146093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:34175 (local address 127.23.229.62:38501)
0809 18:57:05.146170 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.146172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.146192 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:57:05.146216 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.146217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.146241 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.146356 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.147172 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.147967 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.149184 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.149573 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.149711 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.151362 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.151364 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.151364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.151382 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.153812 (+ 2430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.154503 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.154504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.154504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.154607 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.154962 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.154963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.154963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.155178 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.155341 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.155643 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.155784 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for oryx/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab.
Entry for principal oryx/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab.
I20260809 18:57:05.180424 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38501
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab
--principal=oryx/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:05.330312 4093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:05.330819 4093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:05.330861 4093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:05.332536 4093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:05.332603 4093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:05.332629 4093 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:57:05.332648 4093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:57:05.334934 4093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab
--principal=oryx/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:38501
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:05.335261 4093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:05.335662 4093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:05.343833 4105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:05.343921 4104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:05.343899 4107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:05.344422 4093 server_base.cc:1034] running on GCE node
I20260809 18:57:05.344843 4093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:05.345311 4093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:05.346540 4093 hybrid_clock.cc:648] HybridClock initialized: now 1786301825346530 us; error 51 us; skew 500 ppm
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:05.351194 4093 init.cc:377] Logged in from keytab as oryx/127.23.229.2@KRBTEST.COM (short username oryx)
I20260809 18:57:05.352011 4093 webserver.cc:460] Webserver started at http://127.23.229.2:44225/ using document root <none> and password file <none>
I20260809 18:57:05.352399 4093 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:05.352463 4093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:05.352751 4093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:05.354487 4093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "6ef9bccade684e4dbf5017268fa2248e"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "3cf034d8160bf38db68d03b4654f85c9"
server_key_iv: "fb0247d68a4e47efb27ba66741961bdb"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.355005 4093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "6ef9bccade684e4dbf5017268fa2248e"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "3cf034d8160bf38db68d03b4654f85c9"
server_key_iv: "fb0247d68a4e47efb27ba66741961bdb"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.357599 4093 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260809 18:57:05.358831 4119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:05.359122 4093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:05.359292 4093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "6ef9bccade684e4dbf5017268fa2248e"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "3cf034d8160bf38db68d03b4654f85c9"
server_key_iv: "fb0247d68a4e47efb27ba66741961bdb"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.359443 4093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:05.370775 4093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:05.374182 4093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:05.374476 4093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:05.375520 4093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:05.375620 4093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:05.375725 4093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:05.375785 4093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:57:05.392551 4093 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:40597
I20260809 18:57:05.392896 4321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:40597 every 8 connection(s)
I20260809 18:57:05.393446 4093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:05.397822 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.376256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:60031 (local address 127.23.229.62:38501)
0809 18:57:05.376351 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.376354 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.376855 (+ 501us) server_negotiation.cc:407] Connection header received
0809 18:57:05.377821 (+ 966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.377823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.377841 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.377945 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.379006 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.380061 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.382609 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.383152 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.383281 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.390708 (+ 7427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.390711 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.390712 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.390736 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.394330 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.395354 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.395356 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.395356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.395506 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.396125 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.396126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.396127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.396435 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.396693 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.397526 (+ 833us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.397662 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 18:57:05.398134 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.376301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38501 (local address 127.23.229.2:60031)
0809 18:57:05.376675 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.376718 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.377599 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.378084 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.378087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.378473 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:05.378789 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.378801 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.380278 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.380279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.382442 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.382446 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.383385 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.383395 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.383734 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.385861 (+ 2127us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:05.385874 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:05.390384 (+ 4510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:05.394547 (+ 4163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.394554 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.394556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.395153 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.395664 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.395665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.395666 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.395957 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.396676 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:05.396724 (+ 48us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:05.397151 (+ 427us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.397423 (+ 272us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.397742 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":207,"threads_started":1}
I20260809 18:57:05.399700 4324 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38501
I20260809 18:57:05.399879 4324 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:05.400421 4324 heartbeater.cc:511] Master 127.23.229.62:38501 requested a full tablet report, sending...
I20260809 18:57:05.401207 3709 ts_manager.cc:194] Registered new tserver with Master: 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597)
I20260809 18:57:05.401855 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 4093
I20260809 18:57:05.401952 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:05.402097 3709 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:60031
I20260809 18:57:05.402237 24468 external_mini_cluster.cc:1428] Setting key 16da1ef23c21d9a79ca7299e4f65afe3
I20260809 18:57:05.411886 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.401348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43923 (local address 127.23.229.62:38501)
0809 18:57:05.401432 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.401434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.401708 (+ 274us) server_negotiation.cc:407] Connection header received
0809 18:57:05.401870 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.401870 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.401886 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.401927 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.403042 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.403702 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.404960 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.405281 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.405436 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.407067 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.407070 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.407070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.407079 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.409507 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.410232 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.410233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.410234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.410322 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.410750 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.410752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.410752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.411180 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.411295 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.411650 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.411763 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:57:05.412101 4334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.401284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38501 (local address 127.23.229.2:43923)
0809 18:57:05.401604 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.401625 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.401759 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.402182 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.402183 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.402714 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:05.402876 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.402885 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.403849 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.403850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.404808 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.404811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.405432 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.405434 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.405581 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.406351 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:05.406357 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:05.406897 (+ 540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:05.409639 (+ 2742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.409649 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.409650 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.410102 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.410433 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.410434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.410435 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.410599 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.411312 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:05.411313 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:05.411411 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.411609 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.411823 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":224,"threads_started":1}
WARNING: no policy specified for oryx/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab.
Entry for principal oryx/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab.
I20260809 18:57:05.444873 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38501
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab
--principal=oryx/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:05.595884 4340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:05.596246 4340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:05.596311 4340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:05.598238 4340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:05.598337 4340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:05.598376 4340 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:57:05.598408 4340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:57:05.601347 4340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab
--principal=oryx/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.229.62:38501
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:05.601871 4340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:05.602348 4340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:05.611411 4353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:05.611387 4354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:05.611373 4356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:05.612039 4340 server_base.cc:1034] running on GCE node
I20260809 18:57:05.612519 4340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:05.612978 4340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:05.614179 4340 hybrid_clock.cc:648] HybridClock initialized: now 1786301825614145 us; error 65 us; skew 500 ppm
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:05.618743 4340 init.cc:377] Logged in from keytab as oryx/127.23.229.3@KRBTEST.COM (short username oryx)
I20260809 18:57:05.619721 4340 webserver.cc:460] Webserver started at http://127.23.229.3:43655/ using document root <none> and password file <none>
I20260809 18:57:05.620095 4340 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:05.620183 4340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:05.620433 4340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:05.622417 4340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "cb22634b06f747a4a858b9648fa0137f"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "56b44b7cc1ad25ce3ef50ab77dc5faaf"
server_key_iv: "7b9030e583847bfa7692e63f6c780e2d"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.623049 4340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "cb22634b06f747a4a858b9648fa0137f"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "56b44b7cc1ad25ce3ef50ab77dc5faaf"
server_key_iv: "7b9030e583847bfa7692e63f6c780e2d"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.625633 4340 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260809 18:57:05.626861 4370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:05.627158 4340 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:05.627343 4340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "cb22634b06f747a4a858b9648fa0137f"
format_stamp: "Formatted at 2026-08-09 18:57:05 on dist-test-slave-jq4t"
server_key: "56b44b7cc1ad25ce3ef50ab77dc5faaf"
server_key_iv: "7b9030e583847bfa7692e63f6c780e2d"
server_key_version: "encryptionkey@0"
I20260809 18:57:05.627467 4340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:05.646831 4340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:05.650492 4340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:05.650879 4340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:05.652081 4340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:05.652180 4340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:05.652220 4340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:05.652314 4340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:57:05.668275 4340 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:35187
I20260809 18:57:05.668705 4567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:35187 every 8 connection(s)
I20260809 18:57:05.669090 4340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:05.672874 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.652702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:40441 (local address 127.23.229.62:38501)
0809 18:57:05.652787 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.652789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.653308 (+ 519us) server_negotiation.cc:407] Connection header received
0809 18:57:05.654793 (+ 1485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.654795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.654822 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.654990 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.656995 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.657750 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.661115 (+ 3365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.661420 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.661547 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.667565 (+ 6018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.667574 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.667575 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.667584 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.670502 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.671185 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.671186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.671187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.671259 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.671624 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.671624 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.671625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.671939 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.672051 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.672636 (+ 585us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.672773 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:57:05.673352 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.652705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38501 (local address 127.23.229.3:40441)
0809 18:57:05.652996 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.653089 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.654568 (+ 1479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.655203 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.655208 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.656073 (+ 865us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:05.656813 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.656832 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.658027 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.658029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.660922 (+ 2893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.660925 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.661629 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.661631 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.661985 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.663264 (+ 1279us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:05.663301 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:05.667307 (+ 4006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:05.670641 (+ 3334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.670654 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.670657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.671070 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.671355 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.671356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.671357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.671540 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.672068 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:05.672083 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:05.672323 (+ 240us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.672574 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.672871 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":144,"threads_started":1}
I20260809 18:57:05.674286 4568 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38501
I20260809 18:57:05.674465 4568 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:05.674858 4568 heartbeater.cc:511] Master 127.23.229.62:38501 requested a full tablet report, sending...
I20260809 18:57:05.675390 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 4340
I20260809 18:57:05.675581 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:05.675926 24468 external_mini_cluster.cc:1428] Setting key 7c9e6156eb870fe414df209d57efd085
I20260809 18:57:05.676683 3715 ts_manager.cc:194] Registered new tserver with Master: cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187)
I20260809 18:57:05.677407 3715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:40441
I20260809 18:57:05.677798 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:57:05.688133 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.676399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:39195 (local address 127.23.229.62:38501)
0809 18:57:05.676472 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.676500 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.676712 (+ 212us) server_negotiation.cc:407] Connection header received
0809 18:57:05.676996 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.676997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.677024 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.677114 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.677948 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.679090 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.681064 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.681352 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.681435 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.683429 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.683431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.683432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.683452 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.686090 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.686856 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.686857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.686857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.686937 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.687333 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.687333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.687334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.687514 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.687612 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.687910 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.688028 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:57:05.688380 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.676275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38501 (local address 127.23.229.3:39195)
0809 18:57:05.676587 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.676606 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.676722 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.677147 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.677148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.677598 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:05.677740 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.677743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.679309 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.679310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.680879 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.680883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.681460 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.681461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.681652 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.682717 (+ 1065us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:05.682729 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:05.683282 (+ 553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:05.686222 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.686224 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.686224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.686723 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.687053 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.687054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.687054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.687177 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.687619 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:05.687620 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:05.687727 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.687882 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.688110 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":159,"threads_started":1}
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:05.718521 3798 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:05.708647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60394 (local address 127.23.229.62:38501)
0809 18:57:05.708761 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.708763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.708879 (+ 116us) server_negotiation.cc:407] Connection header received
0809 18:57:05.708989 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.708990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.709007 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.709079 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.710206 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.711005 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.712202 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.712562 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.712677 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.718344 (+ 5667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60394: BlockingRecv error: recv got EOF from 127.0.0.1:60394 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301825, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:57:05.730984 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.719873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60404 (local address 127.23.229.62:38501)
0809 18:57:05.719924 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.719926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.720012 (+ 86us) server_negotiation.cc:407] Connection header received
0809 18:57:05.720154 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.720155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.720176 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.720247 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.721265 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.722016 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.723056 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.723358 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.723444 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.727199 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.727201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.727201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.727224 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.729493 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.730013 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.730014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.730014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.730092 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.730302 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.730303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.730303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.730465 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.730605 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.730729 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.730851 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:57:05.733861 3715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60404:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:05.736666 3715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:05.748056 4615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.741592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35214 (local address 127.23.229.2:40597)
0809 18:57:05.741905 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.741912 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.742569 (+ 657us) server_negotiation.cc:407] Connection header received
0809 18:57:05.742720 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.742730 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.742761 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.742931 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.743133 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.744622 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.746236 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.747282 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.747429 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.747580 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.747771 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.747858 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":167,"threads_started":1}
I20260809 18:57:05.748044 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.741194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:40597 (local address 127.0.0.1:35214)
0809 18:57:05.742471 (+ 1277us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.742494 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.742579 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.742928 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.742929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.742931 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.743016 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.743018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.744782 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.744783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.746049 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.746052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.747431 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.747432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.747553 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.747586 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.747740 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.747859 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1244,"thread_start_us":116,"threads_started":1}
I20260809 18:57:05.748557 4606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.740789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35187 (local address 127.0.0.1:38652)
0809 18:57:05.741008 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.741082 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.741192 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.742333 (+ 1141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.742334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.742336 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.742443 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.742445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.744402 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.744403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.746735 (+ 2332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.746738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.748171 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.748172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.748289 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.748305 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.748356 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.748418 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":100,"thread_start_us":263,"threads_started":1}
I20260809 18:57:05.749222 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.741170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38652 (local address 127.23.229.3:35187)
0809 18:57:05.742003 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.742008 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.742037 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:57:05.742112 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.742116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.742136 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.742338 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.742581 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.744188 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.746893 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.748025 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.748732 (+ 707us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.748893 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.748952 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.749029 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":150,"threads_started":1}
I20260809 18:57:05.749464 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.740794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:43653 (local address 127.0.0.1:42004)
0809 18:57:05.741102 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.741129 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.741233 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.742028 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.742034 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.742142 (+ 108us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.742320 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.742331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.744391 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.744392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.746735 (+ 2343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.746738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.749001 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.749002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.749098 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.749104 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.749234 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.749331 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":152,"thread_start_us":113,"threads_started":1}
I20260809 18:57:05.749310 4195 tablet_service.cc:1467] Processing CreateTablet for tablet a5f34ad103e94b55a281cccc3d62d7bc (DEFAULT_TABLE table=test-table [id=4b521e20d4ee4e4a9f86b1ef8b0c3451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.749891 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.741527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42004 (local address 127.23.229.1:43653)
0809 18:57:05.741732 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.741736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.741753 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:05.741845 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.741849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.741883 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.742015 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.742434 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.744207 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.746893 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.748026 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.748801 (+ 775us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.748945 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.749266 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.749776 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":102,"threads_started":1}
I20260809 18:57:05.750090 4195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5f34ad103e94b55a281cccc3d62d7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.751192 3951 tablet_service.cc:1467] Processing CreateTablet for tablet a5f34ad103e94b55a281cccc3d62d7bc (DEFAULT_TABLE table=test-table [id=4b521e20d4ee4e4a9f86b1ef8b0c3451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.751776 3951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5f34ad103e94b55a281cccc3d62d7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.754287 4450 tablet_service.cc:1467] Processing CreateTablet for tablet a5f34ad103e94b55a281cccc3d62d7bc (DEFAULT_TABLE table=test-table [id=4b521e20d4ee4e4a9f86b1ef8b0c3451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.754979 4450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5f34ad103e94b55a281cccc3d62d7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.756062 4617 tablet_bootstrap.cc:492] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Bootstrap starting.
I20260809 18:57:05.757820 4617 tablet_bootstrap.cc:654] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.758569 4617 log.cc:824] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:05.760468 4619 tablet_bootstrap.cc:492] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Bootstrap starting.
I20260809 18:57:05.761715 4619 tablet_bootstrap.cc:654] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.761881 4617 tablet_bootstrap.cc:492] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: No bootstrap required, opened a new log
I20260809 18:57:05.762035 4617 ts_tablet_manager.cc:1397] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 18:57:05.762373 4619 log.cc:824] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:05.762936 4622 tablet_bootstrap.cc:492] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Bootstrap starting.
I20260809 18:57:05.763603 4619 tablet_bootstrap.cc:492] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: No bootstrap required, opened a new log
I20260809 18:57:05.763752 4619 ts_tablet_manager.cc:1397] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:05.763855 4622 tablet_bootstrap.cc:654] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.764559 4622 log.cc:824] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:05.765992 4622 tablet_bootstrap.cc:492] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: No bootstrap required, opened a new log
I20260809 18:57:05.766132 4622 ts_tablet_manager.cc:1397] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:57:05.766567 4617 raft_consensus.cc:348] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.766876 4617 raft_consensus.cc:374] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.766986 4617 raft_consensus.cc:729] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03022ffc82054a638339865ef916520b, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.767194 4617 consensus_queue.cc:260] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.767679 4617 ts_tablet_manager.cc:1428] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 18:57:05.767891 4080 heartbeater.cc:503] Master 127.23.229.62:38501 was elected leader, sending a full tablet report...
I20260809 18:57:05.767741 4619 raft_consensus.cc:348] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.768003 4619 raft_consensus.cc:374] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.768078 4619 raft_consensus.cc:729] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9bccade684e4dbf5017268fa2248e, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.768280 4619 consensus_queue.cc:260] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.768822 4619 ts_tablet_manager.cc:1428] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260809 18:57:05.769117 4324 heartbeater.cc:503] Master 127.23.229.62:38501 was elected leader, sending a full tablet report...
I20260809 18:57:05.770843 4622 raft_consensus.cc:348] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.771060 4622 raft_consensus.cc:374] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.771108 4622 raft_consensus.cc:729] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.771283 4622 consensus_queue.cc:260] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.771685 4622 ts_tablet_manager.cc:1428] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 18:57:05.771795 4568 heartbeater.cc:503] Master 127.23.229.62:38501 was elected leader, sending a full tablet report...
I20260809 18:57:05.793709 4628 raft_consensus.cc:482] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:05.794068 4628 raft_consensus.cc:504] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.794696 4628 leader_election.cc:288] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597)
I20260809 18:57:05.799337 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.794982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:43653 (local address 127.23.229.3:36015)
0809 18:57:05.795170 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.795195 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.795294 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.795615 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.795617 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.795627 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.795743 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.795745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.796834 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.796835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.797939 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.797942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.798838 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.798839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.798999 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.799006 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.799126 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.799192 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":10}
I20260809 18:57:05.799305 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.795077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:36015 (local address 127.23.229.1:43653)
0809 18:57:05.795170 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.795172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.795274 (+ 102us) server_negotiation.cc:407] Connection header received
0809 18:57:05.795441 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.795443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.795463 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.795595 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.795884 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.796670 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.798132 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.798673 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.798867 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.798880 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.799135 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.799196 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 18:57:05.799496 4615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.795398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:51809 (local address 127.23.229.2:40597)
0809 18:57:05.795491 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.795493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.795595 (+ 102us) server_negotiation.cc:407] Connection header received
0809 18:57:05.795751 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.795752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.795774 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.795844 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.796121 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.796889 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.798334 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.798966 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.799101 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.799110 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.799339 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.799389 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:57:05.799527 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.795207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:40597 (local address 127.23.229.3:51809)
0809 18:57:05.795494 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.795509 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.795618 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.795870 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.795871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.795873 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.795985 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.795987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.797065 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.797066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.798178 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.798181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.799102 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.799103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.799204 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.799207 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.799330 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.799384 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":11,"thread_start_us":193,"threads_started":1}
I20260809 18:57:05.800199 3986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5f34ad103e94b55a281cccc3d62d7bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b" is_pre_election: true
I20260809 18:57:05.800622 3986 raft_consensus.cc:2454] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 0.
I20260809 18:57:05.801047 4372 leader_election.cc:302] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03022ffc82054a638339865ef916520b, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:05.800976 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5f34ad103e94b55a281cccc3d62d7bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e" is_pre_election: true
I20260809 18:57:05.801298 4237 raft_consensus.cc:2454] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 0.
I20260809 18:57:05.801297 4628 raft_consensus.cc:2781] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:05.801400 4628 raft_consensus.cc:482] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:05.801476 4628 raft_consensus.cc:3037] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.803139 4628 raft_consensus.cc:504] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.803360 4628 leader_election.cc:288] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 election: Requested vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597)
I20260809 18:57:05.803629 3986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5f34ad103e94b55a281cccc3d62d7bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b"
I20260809 18:57:05.803658 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5f34ad103e94b55a281cccc3d62d7bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e"
I20260809 18:57:05.803808 3986 raft_consensus.cc:3037] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.803802 4237 raft_consensus.cc:3037] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.805213 3986 raft_consensus.cc:2454] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 1.
I20260809 18:57:05.805202 4237 raft_consensus.cc:2454] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 1.
I20260809 18:57:05.805497 4372 leader_election.cc:302] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9bccade684e4dbf5017268fa2248e, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:05.805699 4628 raft_consensus.cc:2781] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:05.806053 4628 raft_consensus.cc:686] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 1 LEADER]: Becoming Leader. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Running, Role: LEADER
I20260809 18:57:05.806234 4628 consensus_queue.cc:237] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } }
I20260809 18:57:05.807854 3715 catalog_manager.cc:5495] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f reported cstate change: term changed from 0 to 1, leader changed from <none> to cb22634b06f747a4a858b9648fa0137f (127.23.229.3). New cstate: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:05.820024 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.816016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38660 (local address 127.23.229.3:35187)
0809 18:57:05.816096 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.816098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.816106 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:05.816155 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.816155 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.816183 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.816284 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:05.816430 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.817242 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.818525 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.818858 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.818953 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.819256 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:05.819490 (+ 234us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:05.819691 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.819794 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.819874 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:57:05.823037 4237 raft_consensus.cc:1261] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Refusing update from remote peer cb22634b06f747a4a858b9648fa0137f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:05.823081 3986 raft_consensus.cc:1261] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Refusing update from remote peer cb22634b06f747a4a858b9648fa0137f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:05.823556 4628 consensus_queue.cc:1035] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:05.823800 4631 consensus_queue.cc:1035] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:05.829041 4637 mvcc.cc:205] Tried to move back new op lower bound from 7316692278566973440 to 7316692278503780352. Current Snapshot: MvccSnapshot[applied={T|T < 7316692278566973440}]
I20260809 18:57:05.829064 4638 mvcc.cc:205] Tried to move back new op lower bound from 7316692278566973440 to 7316692278503780352. Current Snapshot: MvccSnapshot[applied={T|T < 7316692278566973440}]
I20260809 18:57:05.830621 4639 mvcc.cc:205] Tried to move back new op lower bound from 7316692278566973440 to 7316692278503780352. Current Snapshot: MvccSnapshot[applied={T|T < 7316692278566973440 or (T in {7316692278566973440})}]
I20260809 18:57:05.832723 3715 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:05.832885 3715 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:05.834327 3715 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Sending DeleteTablet for 3 replicas of tablet a5f34ad103e94b55a281cccc3d62d7bc
I20260809 18:57:05.835009 4450 tablet_service.cc:1514] Processing DeleteTablet for tablet a5f34ad103e94b55a281cccc3d62d7bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:05 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:38652
I20260809 18:57:05.835016 4195 tablet_service.cc:1514] Processing DeleteTablet for tablet a5f34ad103e94b55a281cccc3d62d7bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:05 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:35214
I20260809 18:57:05.835093 3951 tablet_service.cc:1514] Processing DeleteTablet for tablet a5f34ad103e94b55a281cccc3d62d7bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:05 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:42004
I20260809 18:57:05.835572 4654 tablet_replica.cc:330] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: stopping tablet replica
I20260809 18:57:05.835593 4652 tablet_replica.cc:330] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: stopping tablet replica
I20260809 18:57:05.835749 4652 raft_consensus.cc:2229] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:05.835752 4654 raft_consensus.cc:2229] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:05.835664 3715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60404:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 18:57:05.835971 4652 raft_consensus.cc:2258] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 18:57:05.835980 3715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:05.835997 4654 raft_consensus.cc:2258] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:05.836670 4648 tablet_replica.cc:330] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: stopping tablet replica
I20260809 18:57:05.836826 4648 raft_consensus.cc:2229] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:05.837049 4648 raft_consensus.cc:2258] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:05.837848 4652 ts_tablet_manager.cc:1905] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:05.838469 3951 tablet_service.cc:1467] Processing CreateTablet for tablet b4012fd16fbf4045bee55e1a3def06bc (DEFAULT_TABLE table=test-table [id=e2080e859245480d81a3e1a4f8830f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.838708 3951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4012fd16fbf4045bee55e1a3def06bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.840653 4652 ts_tablet_manager.cc:1918] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:05.840795 4652 log.cc:1196] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/a5f34ad103e94b55a281cccc3d62d7bc
I20260809 18:57:05.841174 4652 ts_tablet_manager.cc:1939] T a5f34ad103e94b55a281cccc3d62d7bc P cb22634b06f747a4a858b9648fa0137f: Deleting consensus metadata
I20260809 18:57:05.841243 4195 tablet_service.cc:1467] Processing CreateTablet for tablet b4012fd16fbf4045bee55e1a3def06bc (DEFAULT_TABLE table=test-table [id=e2080e859245480d81a3e1a4f8830f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.841462 4195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4012fd16fbf4045bee55e1a3def06bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.842504 4648 ts_tablet_manager.cc:1905] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:05.843863 4619 tablet_bootstrap.cc:492] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Bootstrap starting.
I20260809 18:57:05.843899 4617 tablet_bootstrap.cc:492] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Bootstrap starting.
I20260809 18:57:05.844705 4617 tablet_bootstrap.cc:654] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.844722 4619 tablet_bootstrap.cc:654] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.844950 4648 ts_tablet_manager.cc:1918] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:05.845080 4648 log.cc:1196] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/a5f34ad103e94b55a281cccc3d62d7bc
I20260809 18:57:05.845692 4648 ts_tablet_manager.cc:1939] T a5f34ad103e94b55a281cccc3d62d7bc P 6ef9bccade684e4dbf5017268fa2248e: Deleting consensus metadata
I20260809 18:57:05.847998 3679 catalog_manager.cc:4841] TS 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597): tablet a5f34ad103e94b55a281cccc3d62d7bc (table test-table [id=4b521e20d4ee4e4a9f86b1ef8b0c3451]) successfully deleted
I20260809 18:57:05.848325 3682 catalog_manager.cc:4841] TS cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187): tablet a5f34ad103e94b55a281cccc3d62d7bc (table test-table [id=4b521e20d4ee4e4a9f86b1ef8b0c3451]) successfully deleted
I20260809 18:57:05.848582 4450 tablet_service.cc:1467] Processing CreateTablet for tablet b4012fd16fbf4045bee55e1a3def06bc (DEFAULT_TABLE table=test-table [id=e2080e859245480d81a3e1a4f8830f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.848804 4450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4012fd16fbf4045bee55e1a3def06bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.848824 4654 ts_tablet_manager.cc:1905] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:05.849467 4619 tablet_bootstrap.cc:492] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: No bootstrap required, opened a new log
I20260809 18:57:05.849558 4619 ts_tablet_manager.cc:1397] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260809 18:57:05.849861 4619 raft_consensus.cc:348] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.850055 4619 raft_consensus.cc:374] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.850103 4619 raft_consensus.cc:729] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9bccade684e4dbf5017268fa2248e, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.850234 4619 consensus_queue.cc:260] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.850404 4619 ts_tablet_manager.cc:1428] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:05.851686 4622 tablet_bootstrap.cc:492] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Bootstrap starting.
I20260809 18:57:05.851887 4654 ts_tablet_manager.cc:1918] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:05.852058 4654 log.cc:1196] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/a5f34ad103e94b55a281cccc3d62d7bc
I20260809 18:57:05.852627 4622 tablet_bootstrap.cc:654] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.853149 4617 tablet_bootstrap.cc:492] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: No bootstrap required, opened a new log
I20260809 18:57:05.853229 4617 ts_tablet_manager.cc:1397] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20260809 18:57:05.853557 4617 raft_consensus.cc:348] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.853696 4617 raft_consensus.cc:374] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.853756 4617 raft_consensus.cc:729] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03022ffc82054a638339865ef916520b, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.853859 4617 consensus_queue.cc:260] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.853957 4622 tablet_bootstrap.cc:492] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: No bootstrap required, opened a new log
I20260809 18:57:05.854063 4622 ts_tablet_manager.cc:1397] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260809 18:57:05.854094 4617 ts_tablet_manager.cc:1428] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:05.854327 4622 raft_consensus.cc:348] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.854465 4622 raft_consensus.cc:374] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.854527 4622 raft_consensus.cc:729] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.854643 4622 consensus_queue.cc:260] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.854810 4622 ts_tablet_manager.cc:1428] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:05.855362 4654 ts_tablet_manager.cc:1939] T a5f34ad103e94b55a281cccc3d62d7bc P 03022ffc82054a638339865ef916520b: Deleting consensus metadata
I20260809 18:57:05.856209 3679 catalog_manager.cc:4841] TS 03022ffc82054a638339865ef916520b (127.23.229.1:43653): tablet a5f34ad103e94b55a281cccc3d62d7bc (table test-table [id=4b521e20d4ee4e4a9f86b1ef8b0c3451]) successfully deleted
W20260809 18:57:05.890733 4082 tablet.cc:2369] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:57:05.894946 4327 tablet.cc:2369] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:57:05.920153 4570 tablet.cc:2369] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:57:05.945288 4628 raft_consensus.cc:482] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:05.945456 4628 raft_consensus.cc:504] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.945760 4628 leader_election.cc:288] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597)
I20260809 18:57:05.946171 3986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4012fd16fbf4045bee55e1a3def06bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b" is_pre_election: true
I20260809 18:57:05.946358 3986 raft_consensus.cc:2454] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 0.
I20260809 18:57:05.946339 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4012fd16fbf4045bee55e1a3def06bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e" is_pre_election: true
I20260809 18:57:05.946476 4237 raft_consensus.cc:2454] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 0.
I20260809 18:57:05.946640 4372 leader_election.cc:302] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03022ffc82054a638339865ef916520b, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:05.946820 4628 raft_consensus.cc:2781] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:05.946874 4628 raft_consensus.cc:482] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:05.946902 4628 raft_consensus.cc:3037] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.948022 4628 raft_consensus.cc:504] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.948238 4628 leader_election.cc:288] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 election: Requested vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597)
I20260809 18:57:05.948575 3986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4012fd16fbf4045bee55e1a3def06bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b"
I20260809 18:57:05.948601 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4012fd16fbf4045bee55e1a3def06bc" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e"
I20260809 18:57:05.948711 4237 raft_consensus.cc:3037] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.948711 3986 raft_consensus.cc:3037] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.950095 4237 raft_consensus.cc:2454] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 1.
I20260809 18:57:05.950430 4372 leader_election.cc:302] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9bccade684e4dbf5017268fa2248e, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:05.950590 4628 raft_consensus.cc:2781] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:05.950685 4628 raft_consensus.cc:686] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 1 LEADER]: Becoming Leader. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Running, Role: LEADER
I20260809 18:57:05.950835 4628 consensus_queue.cc:237] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:05.950958 3986 raft_consensus.cc:2454] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 1.
I20260809 18:57:05.952267 3715 catalog_manager.cc:5495] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f reported cstate change: term changed from 0 to 1, leader changed from <none> to cb22634b06f747a4a858b9648fa0137f (127.23.229.3). New cstate: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } health_report { overall_health: HEALTHY } } }
Aug 09 18:57:05 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301824, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.62@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:57:05.994415 4669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.981907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38501 (local address 127.0.0.1:60408)
0809 18:57:05.982190 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.982225 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.982319 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.982627 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.982628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.983186 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:05.983270 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.983273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.984774 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.984775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.985529 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.985531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.986227 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.986227 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.986285 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.987204 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:05.987209 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:05.989588 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:05.992656 (+ 3068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.992666 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.992668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.993033 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.993390 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:05.993391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:05.993391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:05.993467 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:05.993978 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:05.993991 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:05.994076 (+ 85us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.994146 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.994302 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":153,"threads_started":1}
I20260809 18:57:05.994617 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.982002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60408 (local address 127.23.229.62:38501)
0809 18:57:05.982135 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.982138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.982327 (+ 189us) server_negotiation.cc:407] Connection header received
0809 18:57:05.982465 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.982466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.982492 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.982598 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.983415 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.984624 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.985668 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.986093 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.986239 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.989725 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.989727 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.989727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.989736 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.992441 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.993162 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.993164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.993164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.993278 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.993558 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.993559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.993559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.993842 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.994040 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.994220 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.994421 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":64}
I20260809 18:57:05.998490 3715 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:60408:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:57:05.998885 3715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:06.001732 4450 tablet_service.cc:1467] Processing CreateTablet for tablet 6cb33847285a415d849d80d4863080c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b17e81bfe1ba400eae1139af058457bd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:57:06.001700 4195 tablet_service.cc:1467] Processing CreateTablet for tablet 6cb33847285a415d849d80d4863080c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b17e81bfe1ba400eae1139af058457bd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:57:06.002080 4450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cb33847285a415d849d80d4863080c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.002090 4195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cb33847285a415d849d80d4863080c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.004215 4622 tablet_bootstrap.cc:492] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: Bootstrap starting.
I20260809 18:57:06.005066 4622 tablet_bootstrap.cc:654] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.005206 4619 tablet_bootstrap.cc:492] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: Bootstrap starting.
I20260809 18:57:06.005559 3951 tablet_service.cc:1467] Processing CreateTablet for tablet 6cb33847285a415d849d80d4863080c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b17e81bfe1ba400eae1139af058457bd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:57:06.005865 3951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cb33847285a415d849d80d4863080c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.006001 4619 tablet_bootstrap.cc:654] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.007129 4622 tablet_bootstrap.cc:492] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: No bootstrap required, opened a new log
I20260809 18:57:06.007248 4622 ts_tablet_manager.cc:1397] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 18:57:06.007547 4622 raft_consensus.cc:348] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.007737 4622 raft_consensus.cc:374] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.007793 4622 raft_consensus.cc:729] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.007848 4619 tablet_bootstrap.cc:492] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: No bootstrap required, opened a new log
I20260809 18:57:06.007926 4619 ts_tablet_manager.cc:1397] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 18:57:06.007889 4622 consensus_queue.cc:260] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.008136 4622 ts_tablet_manager.cc:1428] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:06.008216 4619 raft_consensus.cc:348] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.008396 4619 raft_consensus.cc:374] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.008452 4619 raft_consensus.cc:729] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9bccade684e4dbf5017268fa2248e, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.008460 4628 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.008641 4628 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:06.008616 4619 consensus_queue.cc:260] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.008807 4619 ts_tablet_manager.cc:1428] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:06.009097 4627 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.009253 4627 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:06.010178 4617 tablet_bootstrap.cc:492] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: Bootstrap starting.
I20260809 18:57:06.011076 4617 tablet_bootstrap.cc:654] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.012280 4617 tablet_bootstrap.cc:492] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: No bootstrap required, opened a new log
I20260809 18:57:06.012398 4617 ts_tablet_manager.cc:1397] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:57:06.012763 4617 raft_consensus.cc:348] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.012902 4617 raft_consensus.cc:374] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.012979 4617 raft_consensus.cc:729] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03022ffc82054a638339865ef916520b, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.013104 4617 consensus_queue.cc:260] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.013314 4617 ts_tablet_manager.cc:1428] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 18:57:06.013486 4625 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.013698 4625 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:06.139391 4628 raft_consensus.cc:482] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:06.139626 4628 raft_consensus.cc:504] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.139991 4628 leader_election.cc:288] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597)
I20260809 18:57:06.140408 3986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cb33847285a415d849d80d4863080c1" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b" is_pre_election: true
I20260809 18:57:06.140422 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cb33847285a415d849d80d4863080c1" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e" is_pre_election: true
I20260809 18:57:06.140611 3986 raft_consensus.cc:2454] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 0.
I20260809 18:57:06.140635 4237 raft_consensus.cc:2454] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 0.
I20260809 18:57:06.140939 4372 leader_election.cc:302] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03022ffc82054a638339865ef916520b, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:06.141096 4628 raft_consensus.cc:2781] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:06.141162 4628 raft_consensus.cc:482] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:06.141230 4628 raft_consensus.cc:3037] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.142391 4628 raft_consensus.cc:504] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.142642 4628 leader_election.cc:288] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 election: Requested vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597)
I20260809 18:57:06.142979 3986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cb33847285a415d849d80d4863080c1" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b"
I20260809 18:57:06.143105 3986 raft_consensus.cc:3037] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.143108 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cb33847285a415d849d80d4863080c1" candidate_uuid: "cb22634b06f747a4a858b9648fa0137f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e"
I20260809 18:57:06.143245 4237 raft_consensus.cc:3037] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.144568 3986 raft_consensus.cc:2454] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 1.
I20260809 18:57:06.144711 4237 raft_consensus.cc:2454] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb22634b06f747a4a858b9648fa0137f in term 1.
I20260809 18:57:06.144966 4372 leader_election.cc:302] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03022ffc82054a638339865ef916520b, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:06.145123 4628 raft_consensus.cc:2781] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:06.145213 4628 raft_consensus.cc:686] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [term 1 LEADER]: Becoming Leader. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Running, Role: LEADER
I20260809 18:57:06.145298 4628 consensus_queue.cc:237] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.145819 4631 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: TxnStatusTablet state changed. Reason: New leader cb22634b06f747a4a858b9648fa0137f. Latest consensus state: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.146003 4631 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:57:06.146435 4679 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:57:06.146435 3715 catalog_manager.cc:5495] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f reported cstate change: term changed from 0 to 1, leader changed from <none> to cb22634b06f747a4a858b9648fa0137f (127.23.229.3). New cstate: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } health_report { overall_health: HEALTHY } } }
I20260809 18:57:06.146683 4679 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:57:06.161263 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.156733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38668 (local address 127.23.229.3:35187)
0809 18:57:06.156829 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.156831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.156912 (+ 81us) server_negotiation.cc:407] Connection header received
0809 18:57:06.157080 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.157081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.157098 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.157205 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:06.157401 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.158527 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.159714 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.160181 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.160329 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.160704 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.160773 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.160936 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.161093 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.161139 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:57:06.161257 4669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.156633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35187 (local address 127.0.0.1:38668)
0809 18:57:06.156850 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.156862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.156933 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.157206 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.157207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.157208 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:06.157297 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.157301 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.158720 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.158721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.159586 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.159588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.160373 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.160374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.160539 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.160582 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.160939 (+ 357us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.160953 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.161086 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.161169 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260809 18:57:06.163058 4237 raft_consensus.cc:1261] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Refusing update from remote peer cb22634b06f747a4a858b9648fa0137f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.163106 3986 raft_consensus.cc:1261] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Refusing update from remote peer cb22634b06f747a4a858b9648fa0137f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.163435 4631 consensus_queue.cc:1035] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.163576 4628 consensus_queue.cc:1035] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.164526 4627 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: TxnStatusTablet state changed. Reason: New leader cb22634b06f747a4a858b9648fa0137f. Latest consensus state: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.164726 4627 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:06.164974 4625 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: TxnStatusTablet state changed. Reason: New leader cb22634b06f747a4a858b9648fa0137f. Latest consensus state: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.165171 4625 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:06.166308 4631 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.166460 4631 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:57:06.168047 4625 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.168247 4625 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P 03022ffc82054a638339865ef916520b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:06.168186 4628 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.168347 4628 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P cb22634b06f747a4a858b9648fa0137f: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:57:06.169342 4627 tablet_replica.cc:439] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb22634b06f747a4a858b9648fa0137f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } } }
I20260809 18:57:06.169556 4627 tablet_replica.cc:442] T 6cb33847285a415d849d80d4863080c1 P 6ef9bccade684e4dbf5017268fa2248e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:06.178005 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.174179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:48527 (local address 127.23.229.3:35187)
0809 18:57:06.174249 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.174251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.174269 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:57:06.174389 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.174390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.174406 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.174528 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:06.174815 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.175614 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.176884 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.177136 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.177223 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.177509 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.177570 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.177680 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.177807 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.177843 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":32}
I20260809 18:57:06.178007 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.174080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35187 (local address 127.23.229.3:48527)
0809 18:57:06.174197 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.174222 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.174302 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.174535 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.174536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.174537 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:06.174682 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.174684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.175749 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.175750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.176725 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.176728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.177222 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.177223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.177307 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.177337 (+ 30us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.177685 (+ 348us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.177688 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.177802 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.177890 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:57:06.182256 4237 raft_consensus.cc:1261] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Refusing update from remote peer cb22634b06f747a4a858b9648fa0137f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.182263 3986 raft_consensus.cc:1261] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Refusing update from remote peer cb22634b06f747a4a858b9648fa0137f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.182665 4690 consensus_queue.cc:1035] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.182888 4695 consensus_queue.cc:1035] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.205668 3715 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:06.205863 3715 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:06.207217 3715 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Sending DeleteTablet for 3 replicas of tablet b4012fd16fbf4045bee55e1a3def06bc
I20260809 18:57:06.207937 4195 tablet_service.cc:1514] Processing DeleteTablet for tablet b4012fd16fbf4045bee55e1a3def06bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:35214
I20260809 18:57:06.207934 3951 tablet_service.cc:1514] Processing DeleteTablet for tablet b4012fd16fbf4045bee55e1a3def06bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:42004
I20260809 18:57:06.208158 4654 tablet_replica.cc:330] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: stopping tablet replica
I20260809 18:57:06.208262 4654 raft_consensus.cc:2229] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:06.208328 4654 raft_consensus.cc:2258] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.208345 4648 tablet_replica.cc:330] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: stopping tablet replica
I20260809 18:57:06.208451 4648 raft_consensus.cc:2229] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:06.208599 4648 raft_consensus.cc:2258] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.208593 4450 tablet_service.cc:1514] Processing DeleteTablet for tablet b4012fd16fbf4045bee55e1a3def06bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:38652
I20260809 18:57:06.208863 4652 tablet_replica.cc:330] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: stopping tablet replica
I20260809 18:57:06.208956 4652 raft_consensus.cc:2229] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:06.209090 4652 raft_consensus.cc:2258] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.209312 4648 ts_tablet_manager.cc:1905] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.209623 4652 ts_tablet_manager.cc:1905] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.212554 4648 ts_tablet_manager.cc:1918] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:06.212699 4648 log.cc:1196] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/b4012fd16fbf4045bee55e1a3def06bc
I20260809 18:57:06.213099 4652 ts_tablet_manager.cc:1918] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:06.213241 4652 log.cc:1196] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/b4012fd16fbf4045bee55e1a3def06bc
I20260809 18:57:06.213267 4648 ts_tablet_manager.cc:1939] T b4012fd16fbf4045bee55e1a3def06bc P 6ef9bccade684e4dbf5017268fa2248e: Deleting consensus metadata
I20260809 18:57:06.213706 4652 ts_tablet_manager.cc:1939] T b4012fd16fbf4045bee55e1a3def06bc P cb22634b06f747a4a858b9648fa0137f: Deleting consensus metadata
I20260809 18:57:06.214134 3679 catalog_manager.cc:4841] TS 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597): tablet b4012fd16fbf4045bee55e1a3def06bc (table test-table [id=e2080e859245480d81a3e1a4f8830f72]) successfully deleted
I20260809 18:57:06.214389 3682 catalog_manager.cc:4841] TS cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187): tablet b4012fd16fbf4045bee55e1a3def06bc (table test-table [id=e2080e859245480d81a3e1a4f8830f72]) successfully deleted
I20260809 18:57:06.214557 4654 ts_tablet_manager.cc:1905] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.217504 4654 ts_tablet_manager.cc:1918] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:06.217633 4654 log.cc:1196] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/b4012fd16fbf4045bee55e1a3def06bc
I20260809 18:57:06.218043 4654 ts_tablet_manager.cc:1939] T b4012fd16fbf4045bee55e1a3def06bc P 03022ffc82054a638339865ef916520b: Deleting consensus metadata
I20260809 18:57:06.218758 3679 catalog_manager.cc:4841] TS 03022ffc82054a638339865ef916520b (127.23.229.1:43653): tablet b4012fd16fbf4045bee55e1a3def06bc (table test-table [id=e2080e859245480d81a3e1a4f8830f72]) successfully deleted
Aug 09 18:57:06 dist-test-slave-jq4t krb5kdc[3630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:57:06 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:06 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:06.258431 3798 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:06.246830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60414 (local address 127.23.229.62:38501)
0809 18:57:06.246930 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.246933 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.247142 (+ 209us) server_negotiation.cc:407] Connection header received
0809 18:57:06.247266 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.247267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.247317 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.247426 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:06.248972 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.249755 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.251584 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.251901 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.252120 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.258335 (+ 6215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60414: BlockingRecv error: recv got EOF from 127.0.0.1:60414 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 18:57:06 dist-test-slave-jq4t krb5kdc[3630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM
I20260809 18:57:06.274214 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.259757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60418 (local address 127.23.229.62:38501)
0809 18:57:06.259838 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.259840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.259967 (+ 127us) server_negotiation.cc:407] Connection header received
0809 18:57:06.260031 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.260032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.260045 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.260160 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:06.261128 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.262337 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.263440 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.263918 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.264038 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.268120 (+ 4082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:06.268122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:06.268122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:06.268131 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:06.271815 (+ 3684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:06.272430 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:06.272431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:06.272432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:06.272596 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:06.273061 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:06.273063 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:06.273063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:06.273346 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:06.273539 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.273703 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.273969 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:57:06.277277 3715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:06.277688 3715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:06.280421 4450 tablet_service.cc:1467] Processing CreateTablet for tablet 45a94b08d266447badf6f8116290cb2d (DEFAULT_TABLE table=test-table [id=ffaa245836b844cd9cf70b43977f8148]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:06.280614 4195 tablet_service.cc:1467] Processing CreateTablet for tablet 45a94b08d266447badf6f8116290cb2d (DEFAULT_TABLE table=test-table [id=ffaa245836b844cd9cf70b43977f8148]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:06.280678 3951 tablet_service.cc:1467] Processing CreateTablet for tablet 45a94b08d266447badf6f8116290cb2d (DEFAULT_TABLE table=test-table [id=ffaa245836b844cd9cf70b43977f8148]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:06.280790 4450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a94b08d266447badf6f8116290cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.280905 3951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a94b08d266447badf6f8116290cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.280905 4195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45a94b08d266447badf6f8116290cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.283149 4622 tablet_bootstrap.cc:492] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: Bootstrap starting.
I20260809 18:57:06.283262 4617 tablet_bootstrap.cc:492] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: Bootstrap starting.
I20260809 18:57:06.283262 4619 tablet_bootstrap.cc:492] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: Bootstrap starting.
I20260809 18:57:06.283792 4622 tablet_bootstrap.cc:654] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.284078 4617 tablet_bootstrap.cc:654] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.284077 4619 tablet_bootstrap.cc:654] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.285472 4617 tablet_bootstrap.cc:492] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: No bootstrap required, opened a new log
I20260809 18:57:06.285581 4617 ts_tablet_manager.cc:1397] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:57:06.286020 4622 tablet_bootstrap.cc:492] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: No bootstrap required, opened a new log
I20260809 18:57:06.285943 4617 raft_consensus.cc:348] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.286103 4622 ts_tablet_manager.cc:1397] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 18:57:06.286125 4617 raft_consensus.cc:374] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.286188 4617 raft_consensus.cc:729] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03022ffc82054a638339865ef916520b, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.286298 4617 consensus_queue.cc:260] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.286300 4622 raft_consensus.cc:348] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.286365 4619 tablet_bootstrap.cc:492] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: No bootstrap required, opened a new log
I20260809 18:57:06.286415 4622 raft_consensus.cc:374] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.286448 4619 ts_tablet_manager.cc:1397] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 18:57:06.286464 4622 raft_consensus.cc:729] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.286492 4617 ts_tablet_manager.cc:1428] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:06.286569 4622 consensus_queue.cc:260] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.286708 4622 ts_tablet_manager.cc:1428] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:06.286753 4619 raft_consensus.cc:348] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.286891 4619 raft_consensus.cc:374] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.286979 4619 raft_consensus.cc:729] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9bccade684e4dbf5017268fa2248e, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.287098 4619 consensus_queue.cc:260] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.287344 4619 ts_tablet_manager.cc:1428] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:06.370859 4627 raft_consensus.cc:482] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:06.371075 4627 raft_consensus.cc:504] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.371789 4627 leader_election.cc:288] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187)
I20260809 18:57:06.377924 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.372435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:36761 (local address 127.23.229.3:35187)
0809 18:57:06.372555 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.372557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.372758 (+ 201us) server_negotiation.cc:407] Connection header received
0809 18:57:06.372897 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.372899 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.372921 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.372982 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:06.373434 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.374515 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.376334 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.377159 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.377293 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.377317 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.377663 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.377740 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 18:57:06.378407 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.372147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35187 (local address 127.23.229.2:36761)
0809 18:57:06.372626 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.372648 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.372756 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.373122 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.373123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.373126 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:06.373285 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.373296 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.374707 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.374719 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.376133 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.376137 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.377364 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.377366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.377501 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.377507 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.378137 (+ 630us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.378256 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":84,"thread_start_us":93,"threads_started":1}
I20260809 18:57:06.378888 4740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.372091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:43653 (local address 127.23.229.2:55255)
0809 18:57:06.372370 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.372394 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.372531 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.372871 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.372872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.372885 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:06.372979 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.372981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.374668 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.374669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.376726 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.376730 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.378012 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.378014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.378256 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.378271 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.378386 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.378463 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":42,"thread_start_us":125,"threads_started":1}
I20260809 18:57:06.378908 4487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a94b08d266447badf6f8116290cb2d" candidate_uuid: "6ef9bccade684e4dbf5017268fa2248e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb22634b06f747a4a858b9648fa0137f" is_pre_election: true
I20260809 18:57:06.379202 4487 raft_consensus.cc:2454] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9bccade684e4dbf5017268fa2248e in term 0.
I20260809 18:57:06.379323 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.372376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:55255 (local address 127.23.229.1:43653)
0809 18:57:06.372594 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.372596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.372620 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:57:06.372676 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.372678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.372691 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.372836 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:06.373170 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.374478 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.376861 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.377832 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.377959 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.377970 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.378744 (+ 774us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.378867 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":121,"threads_started":1}
I20260809 18:57:06.379698 3987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a94b08d266447badf6f8116290cb2d" candidate_uuid: "6ef9bccade684e4dbf5017268fa2248e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b" is_pre_election: true
I20260809 18:57:06.379719 4121 leader_election.cc:302] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9bccade684e4dbf5017268fa2248e, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:06.379899 3987 raft_consensus.cc:2454] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9bccade684e4dbf5017268fa2248e in term 0.
I20260809 18:57:06.379977 4627 raft_consensus.cc:2781] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:06.380105 4627 raft_consensus.cc:482] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:06.380162 4627 raft_consensus.cc:3037] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.381855 4627 raft_consensus.cc:504] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.382128 4627 leader_election.cc:288] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [CANDIDATE]: Term 1 election: Requested vote from peers 03022ffc82054a638339865ef916520b (127.23.229.1:43653), cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187)
I20260809 18:57:06.382411 4487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a94b08d266447badf6f8116290cb2d" candidate_uuid: "6ef9bccade684e4dbf5017268fa2248e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb22634b06f747a4a858b9648fa0137f"
I20260809 18:57:06.382521 4487 raft_consensus.cc:3037] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.382472 3987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45a94b08d266447badf6f8116290cb2d" candidate_uuid: "6ef9bccade684e4dbf5017268fa2248e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03022ffc82054a638339865ef916520b"
I20260809 18:57:06.382628 3987 raft_consensus.cc:3037] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.383575 4487 raft_consensus.cc:2454] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9bccade684e4dbf5017268fa2248e in term 1.
I20260809 18:57:06.383912 4121 leader_election.cc:302] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9bccade684e4dbf5017268fa2248e, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:06.384194 4627 raft_consensus.cc:2781] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:06.384413 4627 raft_consensus.cc:686] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 1 LEADER]: Becoming Leader. State: Replica: 6ef9bccade684e4dbf5017268fa2248e, State: Running, Role: LEADER
I20260809 18:57:06.384459 3987 raft_consensus.cc:2454] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9bccade684e4dbf5017268fa2248e in term 1.
I20260809 18:57:06.384569 4627 consensus_queue.cc:237] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.385851 3709 catalog_manager.cc:5495] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2). New cstate: current_term: 1 leader_uuid: "6ef9bccade684e4dbf5017268fa2248e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:06.412436 4749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.407518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35220 (local address 127.23.229.2:40597)
0809 18:57:06.407841 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.407843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.407853 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:06.407941 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.407942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.407993 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.408136 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:06.408294 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.409575 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.410790 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.411329 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.411472 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.411725 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.411988 (+ 263us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.412110 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.412213 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.412248 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":200,"threads_started":1}
I20260809 18:57:06.414204 3987 raft_consensus.cc:1261] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Refusing update from remote peer 6ef9bccade684e4dbf5017268fa2248e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.414479 4487 raft_consensus.cc:1261] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Refusing update from remote peer 6ef9bccade684e4dbf5017268fa2248e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.414757 4745 consensus_queue.cc:1035] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [LEADER]: Connected to new peer: Peer: permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.415004 4627 consensus_queue.cc:1035] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.424556 3709 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:06.424765 3709 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:06.425966 3709 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Sending DeleteTablet for 3 replicas of tablet 45a94b08d266447badf6f8116290cb2d
I20260809 18:57:06.426474 4450 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a94b08d266447badf6f8116290cb2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:38652
I20260809 18:57:06.426549 4195 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a94b08d266447badf6f8116290cb2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:35214
I20260809 18:57:06.426690 3951 tablet_service.cc:1514] Processing DeleteTablet for tablet 45a94b08d266447badf6f8116290cb2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:42004
I20260809 18:57:06.426748 4648 tablet_replica.cc:330] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: stopping tablet replica
I20260809 18:57:06.426824 4648 raft_consensus.cc:2229] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:06.426826 4652 tablet_replica.cc:330] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: stopping tablet replica
I20260809 18:57:06.426925 4652 raft_consensus.cc:2229] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:06.427011 4648 raft_consensus.cc:2258] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.427021 4652 raft_consensus.cc:2258] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.427158 4654 tablet_replica.cc:330] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: stopping tablet replica
I20260809 18:57:06.427251 4654 raft_consensus.cc:2229] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:06.427371 4654 raft_consensus.cc:2258] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.427726 4648 ts_tablet_manager.cc:1905] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.428090 4654 ts_tablet_manager.cc:1905] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.428442 3709 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:06.428774 3709 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:06.430545 4654 ts_tablet_manager.cc:1918] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:06.430667 4654 log.cc:1196] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/45a94b08d266447badf6f8116290cb2d
I20260809 18:57:06.430855 4648 ts_tablet_manager.cc:1918] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:06.430930 4450 tablet_service.cc:1467] Processing CreateTablet for tablet e9def11f75b74dceb2a4adb50c72db1d (DEFAULT_TABLE table=test-table [id=90c9a53239c1462b802343da521bc69f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:06.431003 4648 log.cc:1196] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/45a94b08d266447badf6f8116290cb2d
I20260809 18:57:06.431143 4450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9def11f75b74dceb2a4adb50c72db1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.431155 4654 ts_tablet_manager.cc:1939] T 45a94b08d266447badf6f8116290cb2d P 03022ffc82054a638339865ef916520b: Deleting consensus metadata
I20260809 18:57:06.431489 4648 ts_tablet_manager.cc:1939] T 45a94b08d266447badf6f8116290cb2d P 6ef9bccade684e4dbf5017268fa2248e: Deleting consensus metadata
I20260809 18:57:06.433007 3679 catalog_manager.cc:4841] TS 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597): tablet 45a94b08d266447badf6f8116290cb2d (table test-table [id=ffaa245836b844cd9cf70b43977f8148]) successfully deleted
I20260809 18:57:06.433163 3679 catalog_manager.cc:4841] TS 03022ffc82054a638339865ef916520b (127.23.229.1:43653): tablet 45a94b08d266447badf6f8116290cb2d (table test-table [id=ffaa245836b844cd9cf70b43977f8148]) successfully deleted
I20260809 18:57:06.433874 4652 ts_tablet_manager.cc:1905] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.433913 4622 tablet_bootstrap.cc:492] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: Bootstrap starting.
I20260809 18:57:06.434510 4622 tablet_bootstrap.cc:654] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.436000 4622 tablet_bootstrap.cc:492] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: No bootstrap required, opened a new log
I20260809 18:57:06.436111 4622 ts_tablet_manager.cc:1397] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:57:06.436347 4622 raft_consensus.cc:348] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.436589 4622 raft_consensus.cc:374] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.436643 4622 raft_consensus.cc:729] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb22634b06f747a4a858b9648fa0137f, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.436738 4622 consensus_queue.cc:260] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.437000 4622 ts_tablet_manager.cc:1428] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:06.437343 3951 tablet_service.cc:1467] Processing CreateTablet for tablet e9def11f75b74dceb2a4adb50c72db1d (DEFAULT_TABLE table=test-table [id=90c9a53239c1462b802343da521bc69f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:06.437587 3951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9def11f75b74dceb2a4adb50c72db1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.439006 4195 tablet_service.cc:1467] Processing CreateTablet for tablet e9def11f75b74dceb2a4adb50c72db1d (DEFAULT_TABLE table=test-table [id=90c9a53239c1462b802343da521bc69f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:06.439239 4195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9def11f75b74dceb2a4adb50c72db1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:06.439776 4617 tablet_bootstrap.cc:492] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b: Bootstrap starting.
I20260809 18:57:06.441284 4617 tablet_bootstrap.cc:654] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.441563 4619 tablet_bootstrap.cc:492] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: Bootstrap starting.
I20260809 18:57:06.442312 4619 tablet_bootstrap.cc:654] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:06.442589 4617 tablet_bootstrap.cc:492] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b: No bootstrap required, opened a new log
I20260809 18:57:06.442688 4617 ts_tablet_manager.cc:1397] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 18:57:06.443109 4617 raft_consensus.cc:348] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.443286 4617 raft_consensus.cc:374] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.443341 4617 raft_consensus.cc:729] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03022ffc82054a638339865ef916520b, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.443501 4617 consensus_queue.cc:260] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.437023 4652 ts_tablet_manager.cc:1918] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:06.443646 4652 log.cc:1196] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/45a94b08d266447badf6f8116290cb2d
I20260809 18:57:06.444164 4652 ts_tablet_manager.cc:1939] T 45a94b08d266447badf6f8116290cb2d P cb22634b06f747a4a858b9648fa0137f: Deleting consensus metadata
I20260809 18:57:06.444697 4617 ts_tablet_manager.cc:1428] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 18:57:06.445003 3682 catalog_manager.cc:4841] TS cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187): tablet 45a94b08d266447badf6f8116290cb2d (table test-table [id=ffaa245836b844cd9cf70b43977f8148]) successfully deleted
I20260809 18:57:06.445945 4619 tablet_bootstrap.cc:492] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: No bootstrap required, opened a new log
I20260809 18:57:06.446031 4619 ts_tablet_manager.cc:1397] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260809 18:57:06.446326 4619 raft_consensus.cc:348] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.446483 4619 raft_consensus.cc:374] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:06.446542 4619 raft_consensus.cc:729] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9bccade684e4dbf5017268fa2248e, State: Initialized, Role: FOLLOWER
I20260809 18:57:06.446656 4619 consensus_queue.cc:260] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.446836 4619 ts_tablet_manager.cc:1428] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:06.596405 4625 raft_consensus.cc:482] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:06.596644 4625 raft_consensus.cc:504] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.597290 4625 leader_election.cc:288] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597), cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187)
I20260809 18:57:06.603615 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.597834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:55067 (local address 127.23.229.3:35187)
0809 18:57:06.597927 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.597930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.598069 (+ 139us) server_negotiation.cc:407] Connection header received
0809 18:57:06.598309 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.598319 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.598332 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.598482 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:06.598921 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.600168 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.602321 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.602903 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.603082 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.603105 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.603405 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.603470 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 18:57:06.603703 4764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.597667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35187 (local address 127.23.229.1:55067)
0809 18:57:06.597953 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.597965 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.598170 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.598492 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.598502 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.598505 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:06.598663 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.598666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.600577 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.600578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.602139 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.602142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.603125 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.603127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.603257 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.603261 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.603392 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.603466 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":1,"thread_start_us":177,"threads_started":1}
I20260809 18:57:06.604130 4749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.597778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:58025 (local address 127.23.229.2:40597)
0809 18:57:06.597867 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.597870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.598265 (+ 395us) server_negotiation.cc:407] Connection header received
0809 18:57:06.598479 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.598481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.598503 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.598566 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:06.599023 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.600177 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.602334 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.603393 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.603530 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.603551 (+ 21us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.603889 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.603966 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:57:06.604631 4765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.597939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:40597 (local address 127.23.229.1:58025)
0809 18:57:06.598160 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.598172 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.598307 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.598718 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.598719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.598721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:06.598871 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.598873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.600349 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.600351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.602152 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.602155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.603619 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.603620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.603721 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.603725 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.604347 (+ 622us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.604421 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":58,"thread_start_us":90,"threads_started":1}
I20260809 18:57:06.604655 4487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9def11f75b74dceb2a4adb50c72db1d" candidate_uuid: "03022ffc82054a638339865ef916520b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb22634b06f747a4a858b9648fa0137f" is_pre_election: true
I20260809 18:57:06.604854 4487 raft_consensus.cc:2454] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03022ffc82054a638339865ef916520b in term 0.
I20260809 18:57:06.605261 3863 leader_election.cc:302] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03022ffc82054a638339865ef916520b, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:06.605304 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9def11f75b74dceb2a4adb50c72db1d" candidate_uuid: "03022ffc82054a638339865ef916520b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e" is_pre_election: true
I20260809 18:57:06.605449 4237 raft_consensus.cc:2454] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03022ffc82054a638339865ef916520b in term 0.
I20260809 18:57:06.605512 4625 raft_consensus.cc:2781] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:06.605561 4625 raft_consensus.cc:482] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:06.605585 4625 raft_consensus.cc:3037] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.606940 4625 raft_consensus.cc:504] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.607172 4625 leader_election.cc:288] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597), cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187)
I20260809 18:57:06.607476 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9def11f75b74dceb2a4adb50c72db1d" candidate_uuid: "03022ffc82054a638339865ef916520b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9bccade684e4dbf5017268fa2248e"
I20260809 18:57:06.607527 4487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9def11f75b74dceb2a4adb50c72db1d" candidate_uuid: "03022ffc82054a638339865ef916520b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb22634b06f747a4a858b9648fa0137f"
I20260809 18:57:06.607645 4487 raft_consensus.cc:3037] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.607645 4237 raft_consensus.cc:3037] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:06.609081 4237 raft_consensus.cc:2454] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03022ffc82054a638339865ef916520b in term 1.
I20260809 18:57:06.609081 4487 raft_consensus.cc:2454] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03022ffc82054a638339865ef916520b in term 1.
I20260809 18:57:06.609347 3863 leader_election.cc:302] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03022ffc82054a638339865ef916520b, cb22634b06f747a4a858b9648fa0137f; no voters:
I20260809 18:57:06.609519 4625 raft_consensus.cc:2781] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:06.609826 4625 raft_consensus.cc:686] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [term 1 LEADER]: Becoming Leader. State: Replica: 03022ffc82054a638339865ef916520b, State: Running, Role: LEADER
I20260809 18:57:06.609936 4625 consensus_queue.cc:237] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } }
I20260809 18:57:06.611259 3715 catalog_manager.cc:5495] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b reported cstate change: term changed from 0 to 1, leader changed from <none> to 03022ffc82054a638339865ef916520b (127.23.229.1). New cstate: current_term: 1 leader_uuid: "03022ffc82054a638339865ef916520b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03022ffc82054a638339865ef916520b" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 43653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:06.640996 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.636888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42018 (local address 127.23.229.1:43653)
0809 18:57:06.636962 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.636964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.637010 (+ 46us) server_negotiation.cc:407] Connection header received
0809 18:57:06.637171 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.637172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.637232 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.637428 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:06.637732 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.638446 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.639611 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.639902 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.640031 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.640283 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.640527 (+ 244us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.640714 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.640799 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.640872 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:57:06.648581 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.645251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:46337 (local address 127.23.229.3:35187)
0809 18:57:06.645335 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.645337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.645483 (+ 146us) server_negotiation.cc:407] Connection header received
0809 18:57:06.645577 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.645578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.645587 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.645657 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:06.645843 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.646536 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.647638 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.647893 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.647967 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.648181 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.648224 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.648289 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.648410 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.648444 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:57:06.648659 4773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.645134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35187 (local address 127.23.229.1:46337)
0809 18:57:06.645389 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.645408 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.645489 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.645661 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.645661 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.645663 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:06.645752 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.645754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.646646 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.646647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.647547 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.647549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.647998 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.647998 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.648086 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.648102 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.648290 (+ 188us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.648292 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.648397 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.648464 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":137,"threads_started":1}
I20260809 18:57:06.652712 4487 raft_consensus.cc:1261] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Refusing update from remote peer 03022ffc82054a638339865ef916520b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.652702 4237 raft_consensus.cc:1261] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Refusing update from remote peer 03022ffc82054a638339865ef916520b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:06.653182 4767 consensus_queue.cc:1035] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb22634b06f747a4a858b9648fa0137f" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.653455 4625 consensus_queue.cc:1035] T e9def11f75b74dceb2a4adb50c72db1d P 03022ffc82054a638339865ef916520b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9bccade684e4dbf5017268fa2248e" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 40597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:06.666194 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.662593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:54829 (local address 127.23.229.1:43653)
0809 18:57:06.662663 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.662665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.662682 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:06.662729 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.662730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.662752 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.662841 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:06.663015 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.663696 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.665210 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.665652 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.665734 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.665875 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.665922 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.665979 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.666077 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.666103 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 18:57:06.666209 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.662409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:43653 (local address 127.23.229.3:54829)
0809 18:57:06.662477 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.662490 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:06.662571 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:06.662866 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:06.662867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:06.662869 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:06.662953 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.662955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.663849 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.663850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.665047 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:06.665049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.665734 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.665735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:06.665791 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.665796 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:06.665993 (+ 197us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:06.665994 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:57:06.666072 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:57:06.666125 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 18:57:06.679868 3709 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:06.680066 3709 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:06.681190 3709 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f37ec3bb3c0467eb30d5ec2e7a2ee6e: Sending DeleteTablet for 3 replicas of tablet e9def11f75b74dceb2a4adb50c72db1d
I20260809 18:57:06.681684 4450 tablet_service.cc:1514] Processing DeleteTablet for tablet e9def11f75b74dceb2a4adb50c72db1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:38652
I20260809 18:57:06.681787 4195 tablet_service.cc:1514] Processing DeleteTablet for tablet e9def11f75b74dceb2a4adb50c72db1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:06 UTC) from {username='oryx', principal='oryx/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:35214
I20260809 18:57:06.681989 4652 tablet_replica.cc:330] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: stopping tablet replica
I20260809 18:57:06.682125 4652 raft_consensus.cc:2229] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:06.682212 4652 raft_consensus.cc:2258] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.682212 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 3831
I20260809 18:57:06.682356 4648 tablet_replica.cc:330] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: stopping tablet replica
I20260809 18:57:06.682431 4648 raft_consensus.cc:2229] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:06.682514 4648 raft_consensus.cc:2258] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:06.695794 4652 ts_tablet_manager.cc:1905] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.697631 4648 ts_tablet_manager.cc:1905] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:06.699606 4652 ts_tablet_manager.cc:1918] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:06.699642 4648 ts_tablet_manager.cc:1918] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:06.699769 4648 log.cc:1196] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/e9def11f75b74dceb2a4adb50c72db1d
I20260809 18:57:06.699765 4652 log.cc:1196] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/e9def11f75b74dceb2a4adb50c72db1d
I20260809 18:57:06.700222 4648 ts_tablet_manager.cc:1939] T e9def11f75b74dceb2a4adb50c72db1d P 6ef9bccade684e4dbf5017268fa2248e: Deleting consensus metadata
I20260809 18:57:06.700294 4652 ts_tablet_manager.cc:1939] T e9def11f75b74dceb2a4adb50c72db1d P cb22634b06f747a4a858b9648fa0137f: Deleting consensus metadata
I20260809 18:57:06.701042 3682 catalog_manager.cc:4841] TS cb22634b06f747a4a858b9648fa0137f (127.23.229.3:35187): tablet e9def11f75b74dceb2a4adb50c72db1d (table test-table [id=90c9a53239c1462b802343da521bc69f]) successfully deleted
I20260809 18:57:06.701644 3679 catalog_manager.cc:4841] TS 6ef9bccade684e4dbf5017268fa2248e (127.23.229.2:40597): tablet e9def11f75b74dceb2a4adb50c72db1d (table test-table [id=90c9a53239c1462b802343da521bc69f]) successfully deleted
W20260809 18:57:06.708529 3679 connection.cc:535] client connection to 127.23.229.1:43653 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 18:57:06.708882 3679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 18:57:06.709237 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 4093
I20260809 18:57:06.727845 4787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.709493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:43653 (local address 127.0.0.1:42024)
0809 18:57:06.727506 (+ 18013us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.727729 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:43653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17959,"thread_start_us":80,"threads_started":1}
W20260809 18:57:06.728154 3679 catalog_manager.cc:4584] TS 03022ffc82054a638339865ef916520b (127.23.229.1:43653): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e9def11f75b74dceb2a4adb50c72db1d: Network error: Client connection negotiation failed: client connection to 127.23.229.1:43653: connect: Connection refused (error 111)
I20260809 18:57:06.736768 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 4340
I20260809 18:57:06.765775 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 3648
2026-08-09T18:57:06Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4157 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:06 dist-test-slave-jq4t krb5kdc[4792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:06 dist-test-slave-jq4t krb5kdc[4792](info): set up 2 sockets
Aug 09 18:57:06 dist-test-slave-jq4t krb5kdc[4792](info): commencing operation
krb5kdc: starting...
W20260809 18:57:08.261896 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.447s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:57:08 dist-test-slave-jq4t krb5kdc[4792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:57:08.389565 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41851
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:37093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:41851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:08.478430 4815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:08.478710 4815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:08.478755 4815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:08.479955 4815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:08.480031 4815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:08.480059 4815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:08.480079 4815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:08.480100 4815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:08.481752 4815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:37093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:41851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:08.482075 4815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:08.482332 4815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:08.487715 4825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:08.487740 4823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:08.487715 4822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:08.488049 4815 server_base.cc:1034] running on GCE node
I20260809 18:57:08.488348 4815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:08.488749 4815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:08.489921 4815 hybrid_clock.cc:648] HybridClock initialized: now 1786301828489906 us; error 46 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T18:57:08Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1704 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:08 dist-test-slave-jq4t krb5kdc[4833](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:08 dist-test-slave-jq4t krb5kdc[4833](info): set up 2 sockets
Aug 09 18:57:08 dist-test-slave-jq4t krb5kdc[4833](info): commencing operation
krb5kdc: starting...
W20260809 18:57:09.758392 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:57:09 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:57:09.891044 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41231
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:41231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:09.977737 4858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:09.978020 4858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:09.978060 4858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:09.979236 4858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:09.979319 4858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:09.979349 4858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:09.979378 4858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:09.979409 4858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:09.980985 4858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:41231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:09.981298 4858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:09.981557 4858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:09.986745 4869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:09.986716 4870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:09.986721 4874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:09.986806 4858 server_base.cc:1034] running on GCE node
I20260809 18:57:09.987337 4858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:09.987670 4858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:09.988821 4858 hybrid_clock.cc:648] HybridClock initialized: now 1786301829988811 us; error 37 us; skew 500 ppm
Aug 09 18:57:09 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301829, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:09.991503 4858 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:57:09.991999 4858 webserver.cc:460] Webserver started at http://127.23.229.62:36511/ using document root <none> and password file <none>
I20260809 18:57:09.992255 4858 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:09.992326 4858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:09.992523 4858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:09.993661 4858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "1121e2b497e147feb3fbad1902d8670e"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-jq4t"
server_key: "cea3f763953a46a8924a378d31d7e335"
server_key_iv: "f8269005bbd1e5a3fc42e4a806447650"
server_key_version: "encryptionkey@0"
I20260809 18:57:09.994051 4858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "1121e2b497e147feb3fbad1902d8670e"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-jq4t"
server_key: "cea3f763953a46a8924a378d31d7e335"
server_key_iv: "f8269005bbd1e5a3fc42e4a806447650"
server_key_version: "encryptionkey@0"
I20260809 18:57:09.995546 4858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:57:09.996428 4884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:09.996695 4858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:09.996811 4858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "1121e2b497e147feb3fbad1902d8670e"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-jq4t"
server_key: "cea3f763953a46a8924a378d31d7e335"
server_key_iv: "f8269005bbd1e5a3fc42e4a806447650"
server_key_version: "encryptionkey@0"
I20260809 18:57:09.996914 4858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:10.015798 4858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:10.018043 4858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:10.018235 4858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:10.022570 4858 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:41231
I20260809 18:57:10.022627 5004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:41231 every 8 connection(s)
I20260809 18:57:10.023036 4858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:10.024040 5005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.026492 5005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Bootstrap starting.
I20260809 18:57:10.027114 5005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.027328 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 4858
I20260809 18:57:10.027380 5005 log.cc:824] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:10.027427 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:57:10.027580 24468 external_mini_cluster.cc:1428] Setting key e489dd49bf106c82b8601da71bfdc91f
I20260809 18:57:10.028437 5005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: No bootstrap required, opened a new log
I20260809 18:57:10.030570 5005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.030742 5005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.030791 5005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1121e2b497e147feb3fbad1902d8670e, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.030977 5005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.031077 5005 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:10.031126 5005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:10.031180 5005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.031773 5005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.031903 5005 leader_election.cc:302] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1121e2b497e147feb3fbad1902d8670e; no voters:
I20260809 18:57:10.032143 5005 leader_election.cc:288] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:10.032174 5017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:10.032289 5017 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 LEADER]: Becoming Leader. State: Replica: 1121e2b497e147feb3fbad1902d8670e, State: Running, Role: LEADER
I20260809 18:57:10.032387 5017 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.032442 5005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:10.032773 5017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1121e2b497e147feb3fbad1902d8670e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } } }
I20260809 18:57:10.032845 5017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:10.032979 5017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1121e2b497e147feb3fbad1902d8670e. Latest consensus state: current_term: 1 leader_uuid: "1121e2b497e147feb3fbad1902d8670e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } } }
I20260809 18:57:10.033041 5017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:10.033166 5031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:10.033722 5031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:10.035529 5031 catalog_manager.cc:1347] Generated new cluster ID: 179bba501e5f4066bccd1f2d46aabf5f
I20260809 18:57:10.035589 5031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:10.039659 5013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.028092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58942 (local address 127.23.229.62:41231)
0809 18:57:10.028288 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.028299 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.028337 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:57:10.028893 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.028901 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.028955 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.029111 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.029767 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.030660 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.031622 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.032160 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.032288 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.035587 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.035592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.035593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.035606 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.037701 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.038176 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.038179 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.038180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.038289 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.038536 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.038536 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.038537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.038857 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.039029 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.039164 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.039311 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
I20260809 18:57:10.066139 5031 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:10.066771 5031 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:10.071318 5031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Generated new TSK 0
I20260809 18:57:10.071549 5031 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:57:10.103986 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41231
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:10.190057 5061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:10.190272 5061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:10.190296 5061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:10.191501 5061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:10.191546 5061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:10.191605 5061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:57:10.193156 5061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:10.193421 5061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:10.193666 5061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:10.198942 5072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.198987 5073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.199011 5079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:10.199227 5061 server_base.cc:1034] running on GCE node
I20260809 18:57:10.199538 5061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:10.199808 5061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:10.200964 5061 hybrid_clock.cc:648] HybridClock initialized: now 1786301830200964 us; error 41 us; skew 500 ppm
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:10.203630 5061 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:57:10.204154 5061 webserver.cc:460] Webserver started at http://127.23.229.1:45291/ using document root <none> and password file <none>
I20260809 18:57:10.204398 5061 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:10.204448 5061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:10.204627 5061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:10.205762 5061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "d997f24b96f047d3a6882eaa1d182f69"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "f7951c1bd21203eaa8efe2091bf5b5c5"
server_key_iv: "13b66eb642b4ede0141f9f21e753807d"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.206132 5061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "d997f24b96f047d3a6882eaa1d182f69"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "f7951c1bd21203eaa8efe2091bf5b5c5"
server_key_iv: "13b66eb642b4ede0141f9f21e753807d"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.207558 5061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:57:10.208312 5089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.208542 5061 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:10.208647 5061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "d997f24b96f047d3a6882eaa1d182f69"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "f7951c1bd21203eaa8efe2091bf5b5c5"
server_key_iv: "13b66eb642b4ede0141f9f21e753807d"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.208734 5061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:10.219545 5061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:10.221566 5061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:10.221740 5061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:10.221982 5061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:10.222321 5061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:10.222380 5061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.222419 5061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:10.222447 5061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.228440 5061 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:41295
I20260809 18:57:10.228514 5302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:41295 every 8 connection(s)
I20260809 18:57:10.228843 5061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:10.230571 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 5061
I20260809 18:57:10.230688 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:10.230924 24468 external_mini_cluster.cc:1428] Setting key ddbf3631f83829c082c5c82331df9fef
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:10.240047 5013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.229641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:60937 (local address 127.23.229.62:41231)
0809 18:57:10.230769 (+ 1128us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.230771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.230783 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:57:10.230831 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.230832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.230843 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.230914 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.232310 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.232934 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.234254 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.234599 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.234694 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.236958 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.236961 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.236961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.236971 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.238629 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.239017 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.239019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.239019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.239091 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.239334 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.239335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.239335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.239495 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.239577 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.239823 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.239934 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1096}
I20260809 18:57:10.240075 5309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.229625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:60937)
0809 18:57:10.229824 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.229869 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.230400 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.231046 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.231051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.231906 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:10.232209 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.232216 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.233037 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.233038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.234159 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.234161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.234699 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.234700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.234803 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.235377 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:10.235385 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:10.236857 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:10.238714 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.238722 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.238724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.238938 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.239165 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.239165 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.239166 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.239265 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.239568 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:10.239573 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:10.239690 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.239772 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.239898 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":98,"threads_started":1}
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 18:57:10.241084 5304 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41231
I20260809 18:57:10.241207 5304 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:10.241401 5304 heartbeater.cc:511] Master 127.23.229.62:41231 requested a full tablet report, sending...
I20260809 18:57:10.242017 4925 ts_manager.cc:194] Registered new tserver with Master: d997f24b96f047d3a6882eaa1d182f69 (127.23.229.1:41295)
I20260809 18:57:10.242658 4925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:60937
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:57:10.259796 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41231
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:10.345692 5315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:10.345961 5315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:10.346001 5315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:10.347184 5315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:10.347255 5315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:10.347301 5315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:57:10.348876 5315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:10.349159 5315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:10.349411 5315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:10.354630 5322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:10.354803 5315 server_base.cc:1034] running on GCE node
W20260809 18:57:10.354645 5324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.354653 5327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:10.355185 5315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:10.355525 5315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:10.356673 5315 hybrid_clock.cc:648] HybridClock initialized: now 1786301830356655 us; error 42 us; skew 500 ppm
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:10.359375 5315 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:57:10.359786 5315 webserver.cc:460] Webserver started at http://127.23.229.2:46795/ using document root <none> and password file <none>
I20260809 18:57:10.359977 5315 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:10.360019 5315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:10.360121 5315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:10.361231 5315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "529a7e10cdac4e8bb9786cb0e032e519"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "72df3111e1f1c50aab4e2f6c1c431d48"
server_key_iv: "21a21df08e0655194922314b2f581139"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.361552 5315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "529a7e10cdac4e8bb9786cb0e032e519"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "72df3111e1f1c50aab4e2f6c1c431d48"
server_key_iv: "21a21df08e0655194922314b2f581139"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.362880 5315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:57:10.363734 5337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.363919 5315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:10.364039 5315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "529a7e10cdac4e8bb9786cb0e032e519"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "72df3111e1f1c50aab4e2f6c1c431d48"
server_key_iv: "21a21df08e0655194922314b2f581139"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.364125 5315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:10.375126 5315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:10.377732 5315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:10.377921 5315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:10.378211 5315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:10.378574 5315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:10.378633 5315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.378671 5315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:10.378720 5315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.385708 5315 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:44225
I20260809 18:57:10.385743 5546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:44225 every 8 connection(s)
I20260809 18:57:10.386163 5315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:10.396047 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 5315
I20260809 18:57:10.396183 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:10.396338 5013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.387049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:32853 (local address 127.23.229.62:41231)
0809 18:57:10.387148 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.387151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.387375 (+ 224us) server_negotiation.cc:407] Connection header received
0809 18:57:10.387876 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.387877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.387889 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.387948 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.389057 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.389584 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.390652 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.390864 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.390928 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.393295 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.393297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.393297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.393305 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.394775 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.395206 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.395207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.395207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.395271 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.395533 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.395533 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.395534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.395651 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.395708 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.396077 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.396199 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 18:57:10.396412 24468 external_mini_cluster.cc:1428] Setting key 58f51b3bcbdbef208164054636693762
I20260809 18:57:10.396535 5552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.387019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:32853)
0809 18:57:10.387231 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.387272 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.387783 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.388006 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.388009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.388740 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:10.388959 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.388964 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.389681 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.389682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.390552 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.390555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.390950 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.390951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.391072 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.391641 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:10.391651 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:10.393197 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:10.394859 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.394866 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.394868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.395084 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.395359 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.395360 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.395361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.395471 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.395712 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:10.395718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:10.395915 (+ 197us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.396049 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.396250 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":125,"threads_started":1}
I20260809 18:57:10.397071 5550 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41231
I20260809 18:57:10.397198 5550 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:10.397441 5550 heartbeater.cc:511] Master 127.23.229.62:41231 requested a full tablet report, sending...
I20260809 18:57:10.397985 4925 ts_manager.cc:194] Registered new tserver with Master: 529a7e10cdac4e8bb9786cb0e032e519 (127.23.229.2:44225)
I20260809 18:57:10.398512 4925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:32853
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:57:10.423653 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41231
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:10.509820 5557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:10.510042 5557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:10.510066 5557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:10.511253 5557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:10.511294 5557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:10.511320 5557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:57:10.512842 5557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:10.513038 5557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:10.513221 5557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:10.518280 5573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.518204 5567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.518204 5576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:10.518498 5557 server_base.cc:1034] running on GCE node
I20260809 18:57:10.518756 5557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:10.519047 5557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:10.520227 5557 hybrid_clock.cc:648] HybridClock initialized: now 1786301830520198 us; error 42 us; skew 500 ppm
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:10.522783 5557 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:57:10.523262 5557 webserver.cc:460] Webserver started at http://127.23.229.3:43149/ using document root <none> and password file <none>
I20260809 18:57:10.523506 5557 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:10.523581 5557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:10.523741 5557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:10.524953 5557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "edfac5f68d8b48af9e1653f6ea8dbcbf"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "e685a40ee7cdca89843231377040eac1"
server_key_iv: "ffd4d588aeacfe1ececc974ab7134673"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.525331 5557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "edfac5f68d8b48af9e1653f6ea8dbcbf"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "e685a40ee7cdca89843231377040eac1"
server_key_iv: "ffd4d588aeacfe1ececc974ab7134673"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.526712 5557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:57:10.527467 5585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.527643 5557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:57:10.527745 5557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "edfac5f68d8b48af9e1653f6ea8dbcbf"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "e685a40ee7cdca89843231377040eac1"
server_key_iv: "ffd4d588aeacfe1ececc974ab7134673"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.527828 5557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:10.550604 5557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:10.552947 5557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:10.553107 5557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:10.553368 5557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:10.553728 5557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:10.553786 5557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.553833 5557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:10.553859 5557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.559913 5557 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:35891
I20260809 18:57:10.560037 5782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:35891 every 8 connection(s)
I20260809 18:57:10.560352 5557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:10.569404 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 5557
I20260809 18:57:10.569515 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:10.569706 24468 external_mini_cluster.cc:1428] Setting key ccaf8e24cde7e0a3ae181b1d5a6ac0eb
I20260809 18:57:10.570312 5013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.561212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:44649 (local address 127.23.229.62:41231)
0809 18:57:10.561264 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.561266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.561470 (+ 204us) server_negotiation.cc:407] Connection header received
0809 18:57:10.561952 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.561953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.561963 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.562024 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.563060 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.563603 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.564770 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.564993 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.565075 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.567353 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.567355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.567355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.567363 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.568725 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.569141 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.569143 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.569143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.569228 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.569512 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.569513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.569513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.569690 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.569770 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.570127 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.570219 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:57:10.570492 5788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.561157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:44649)
0809 18:57:10.561330 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.561373 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.561864 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.562080 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.562083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.562674 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:10.562875 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.562879 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.563733 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.563735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.564678 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.564681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.565085 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.565086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.565224 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.565795 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:10.565804 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:10.567241 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:10.568817 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.568824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.568826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.569047 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.569310 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.569311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.569311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.569423 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.569772 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:10.569779 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:10.569959 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.570089 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.570256 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260809 18:57:10.570978 5785 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41231
I20260809 18:57:10.571102 5785 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:10.571300 5785 heartbeater.cc:511] Master 127.23.229.62:41231 requested a full tablet report, sending...
I20260809 18:57:10.571715 4925 ts_manager.cc:194] Registered new tserver with Master: edfac5f68d8b48af9e1653f6ea8dbcbf (127.23.229.3:35891)
I20260809 18:57:10.572116 4925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:44649
I20260809 18:57:10.581715 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab.
Entry for principal oryx/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab.
WARNING: no policy specified for oryx/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab.
Entry for principal oryx/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab.
WARNING: no policy specified for oryx/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab.
Entry for principal oryx/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab.
I20260809 18:57:10.661247 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 5061
I20260809 18:57:10.690231 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 5315
I20260809 18:57:10.700587 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 5557
I20260809 18:57:10.711094 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 4858
I20260809 18:57:10.724818 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41231
--webserver_interface=127.23.229.62
--webserver_port=36511
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:41231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:10.818173 5798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:10.818444 5798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:10.818470 5798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:10.819818 5798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:10.819873 5798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:10.819890 5798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:10.819904 5798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:10.819967 5798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:10.821703 5798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:41231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=36511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:10.822021 5798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:10.822292 5798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:10.828127 5811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.828135 5809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.828135 5816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:10.828445 5798 server_base.cc:1034] running on GCE node
I20260809 18:57:10.828783 5798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:10.829149 5798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:10.830328 5798 hybrid_clock.cc:648] HybridClock initialized: now 1786301830830305 us; error 45 us; skew 500 ppm
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:10.833092 5798 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:57:10.833518 5798 webserver.cc:460] Webserver started at http://127.23.229.62:36511/ using document root <none> and password file <none>
I20260809 18:57:10.833737 5798 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:10.833791 5798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:10.835170 5798 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:10.835889 5831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.836128 5798 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:57:10.836225 5798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "1121e2b497e147feb3fbad1902d8670e"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-jq4t"
server_key: "cea3f763953a46a8924a378d31d7e335"
server_key_iv: "f8269005bbd1e5a3fc42e4a806447650"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.836674 5798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:10.848194 5798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:10.850845 5798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:10.850977 5798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:10.855492 5798 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:41231
I20260809 18:57:10.855585 5916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:41231 every 8 connection(s)
I20260809 18:57:10.855988 5798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:10.857672 5917 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:57:10.858395 5917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Bootstrap starting.
I20260809 18:57:10.860587 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 5798
I20260809 18:57:10.860944 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:41295
--local_ip_for_outbound_sockets=127.23.229.1
--tserver_master_addrs=127.23.229.62:41231
--webserver_port=45291
--webserver_interface=127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:57:10.868572 5917 log.cc:824] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:10.870380 5917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:57:10.870700 5917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Bootstrap complete.
I20260809 18:57:10.873230 5917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.873492 5917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1121e2b497e147feb3fbad1902d8670e, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.873713 5917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.873818 5917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:10.873876 5917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:10.873925 5917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:57:10.874943 5917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.875070 5917 leader_election.cc:302] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1121e2b497e147feb3fbad1902d8670e; no voters:
I20260809 18:57:10.875288 5917 leader_election.cc:288] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:57:10.875324 5925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:57:10.875474 5925 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [term 2 LEADER]: Becoming Leader. State: Replica: 1121e2b497e147feb3fbad1902d8670e, State: Running, Role: LEADER
I20260809 18:57:10.875591 5917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:10.875569 5925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } }
I20260809 18:57:10.875840 5928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1121e2b497e147feb3fbad1902d8670e. Latest consensus state: current_term: 2 leader_uuid: "1121e2b497e147feb3fbad1902d8670e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } } }
I20260809 18:57:10.875939 5928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:10.875852 5927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1121e2b497e147feb3fbad1902d8670e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1121e2b497e147feb3fbad1902d8670e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41231 } } }
I20260809 18:57:10.876164 5927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:10.876638 5930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:10.877188 5930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:10.877331 5930 catalog_manager.cc:1259] Loaded cluster ID: 179bba501e5f4066bccd1f2d46aabf5f
I20260809 18:57:10.877373 5930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:10.878657 5930 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:10.878855 5930 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1121e2b497e147feb3fbad1902d8670e: Loaded TSK: 0
I20260809 18:57:10.879096 5930 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:57:10.953274 5922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:10.953526 5922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:10.953563 5922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:10.954753 5922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:10.954823 5922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:10.954878 5922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:57:10.956398 5922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.1.keytab
--principal=oryx/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:41295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=45291
--tserver_master_addrs=127.23.229.62:41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:10.956686 5922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:10.956992 5922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:10.962519 5966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.962548 5962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:10.962519 5964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:10.963181 5922 server_base.cc:1034] running on GCE node
I20260809 18:57:10.963446 5922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:10.963711 5922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:10.964869 5922 hybrid_clock.cc:648] HybridClock initialized: now 1786301830964850 us; error 35 us; skew 500 ppm
Aug 09 18:57:10 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:10.967970 5922 init.cc:377] Logged in from keytab as oryx/127.23.229.1@KRBTEST.COM (short username oryx)
I20260809 18:57:10.968570 5922 webserver.cc:460] Webserver started at http://127.23.229.1:45291/ using document root <none> and password file <none>
I20260809 18:57:10.968850 5922 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:10.968950 5922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:10.970854 5922 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:57:10.971598 5975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.971799 5922 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:10.971905 5922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "d997f24b96f047d3a6882eaa1d182f69"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "f7951c1bd21203eaa8efe2091bf5b5c5"
server_key_iv: "13b66eb642b4ede0141f9f21e753807d"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.972285 5922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:10.990486 5922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:10.992988 5922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:10.993178 5922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:10.993456 5922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:10.993803 5922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:10.993863 5922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.993919 5922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:10.993950 5922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:11.000643 5922 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:41295
I20260809 18:57:11.000698 6208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:41295 every 8 connection(s)
I20260809 18:57:11.001068 5922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:11.007865 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 5922
I20260809 18:57:11.008270 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:44225
--local_ip_for_outbound_sockets=127.23.229.2
--tserver_master_addrs=127.23.229.62:41231
--webserver_port=46795
--webserver_interface=127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:11.011387 6216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.001912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:52951)
0809 18:57:11.002114 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.002172 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.002711 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.003230 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.003234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.003860 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.004072 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.004078 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.005704 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.005705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.006536 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.006538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.007313 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.007314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.007419 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.008134 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.008146 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.011155 (+ 3009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
W20260809 18:57:11.011433 6218 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.002050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:52951 (local address 127.23.229.62:41231)
0809 18:57:11.002288 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.002297 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.002345 (+ 48us) server_negotiation.cc:407] Connection header received
0809 18:57:11.002924 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.002932 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.002991 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.003148 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.004209 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.005578 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.006631 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.007217 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.007327 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.011290 (+ 3963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:52951: BlockingRecv error: recv got EOF from 127.23.229.1:52951 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":114,"threads_started":1}
W20260809 18:57:11.011708 6211 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:41231 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.229.62:41231: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:11.016808 6216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.011954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:51577)
0809 18:57:11.012011 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.012024 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.012071 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.012375 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.012376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.012578 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.012634 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.012636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.013290 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.013291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.013805 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.013806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.014168 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.014169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.014236 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.014753 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.014757 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.016719 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 18:57:11.016885 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.012056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:51577 (local address 127.23.229.62:41231)
0809 18:57:11.012252 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.012254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.012260 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:57:11.012280 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.012281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.012290 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.012369 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.012713 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.013206 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.013888 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.014092 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.014170 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.016802 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:51577: BlockingRecv error: recv got EOF from 127.23.229.1:51577 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":135,"threads_started":1}
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:11.021394 6216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.017119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:35011)
0809 18:57:11.017160 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.017170 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.017209 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.017332 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.017333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.017462 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.017489 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.017490 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.018116 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.018117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.018609 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.018610 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.018984 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.018986 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.019048 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.019540 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.019544 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.021308 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 18:57:11.021448 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.017159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:35011 (local address 127.23.229.62:41231)
0809 18:57:11.017194 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.017195 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.017204 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:57:11.017259 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.017259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.017270 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.017323 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.017577 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.018036 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.018699 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.018897 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.018984 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.021385 (+ 2401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:35011: BlockingRecv error: recv got EOF from 127.23.229.1:35011 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 18:57:11.021546 6211 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:57:11.096990 6222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:11.097271 6222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:11.097312 6222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:11.098538 6222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:11.098614 6222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:11.098657 6222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:57:11.100148 6222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.2.keytab
--principal=oryx/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:44225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=46795
--tserver_master_addrs=127.23.229.62:41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:11.100441 6222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:11.100714 6222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:11.106038 6242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:11.106077 6237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:11.106067 6236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:11.106261 6222 server_base.cc:1034] running on GCE node
I20260809 18:57:11.106506 6222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:11.106807 6222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:11.107980 6222 hybrid_clock.cc:648] HybridClock initialized: now 1786301831107965 us; error 29 us; skew 500 ppm
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301831, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:11.110648 6222 init.cc:377] Logged in from keytab as oryx/127.23.229.2@KRBTEST.COM (short username oryx)
I20260809 18:57:11.111111 6222 webserver.cc:460] Webserver started at http://127.23.229.2:46795/ using document root <none> and password file <none>
I20260809 18:57:11.111353 6222 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:11.111444 6222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:11.112910 6222 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:57:11.113530 6254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:11.113703 6222 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:57:11.113814 6222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "529a7e10cdac4e8bb9786cb0e032e519"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "72df3111e1f1c50aab4e2f6c1c431d48"
server_key_iv: "21a21df08e0655194922314b2f581139"
server_key_version: "encryptionkey@0"
I20260809 18:57:11.114202 6222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:11.131183 6222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:11.133407 6222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:11.133608 6222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:11.133884 6222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:11.134245 6222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:11.134305 6222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:11.134353 6222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:11.134378 6222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:11.140444 6222 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:44225
I20260809 18:57:11.140555 6465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:44225 every 8 connection(s)
I20260809 18:57:11.140928 6222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:11.145614 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 6222
I20260809 18:57:11.145987 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:35891
--local_ip_for_outbound_sockets=127.23.229.3
--tserver_master_addrs=127.23.229.62:41231
--webserver_port=43149
--webserver_interface=127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:11.148805 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.141755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:42195 (local address 127.23.229.62:41231)
0809 18:57:11.141849 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.141852 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.142046 (+ 194us) server_negotiation.cc:407] Connection header received
0809 18:57:11.142531 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.142532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.142548 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.142602 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.143556 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.144071 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.145098 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.145292 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.145390 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.148747 (+ 3357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:42195: BlockingRecv error: recv got EOF from 127.23.229.2:42195 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:57:11.148957 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.141716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:42195)
0809 18:57:11.141909 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.141949 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.142439 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.142660 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.142663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.143260 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.143471 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.143476 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.144161 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.144162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.145016 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.145019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.145372 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.145373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.145480 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.146144 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.146157 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.148650 (+ 2493us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
W20260809 18:57:11.149216 6466 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:41231 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.229.62:41231: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:11.154119 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.149496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:35265)
0809 18:57:11.149543 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.149553 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.149596 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.149752 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.149753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.149895 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.149941 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.149942 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.150616 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.150617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.151156 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.151158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.151538 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.151539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.151610 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.152136 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.152141 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.154019 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:57:11.154173 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.149553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:35265 (local address 127.23.229.62:41231)
0809 18:57:11.149615 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.149617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.149625 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:11.149651 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.149652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.149665 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.149733 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.150028 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.150518 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.151244 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.151451 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.151535 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.154105 (+ 2570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:35265: BlockingRecv error: recv got EOF from 127.23.229.2:35265 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:11.158720 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.154425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:57387)
0809 18:57:11.154470 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.154480 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.154518 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.154663 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.154663 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.154793 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.154821 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.154822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.155461 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.155462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.155948 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.155949 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.156319 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.156320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.156377 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.156871 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.156876 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.158632 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:57:11.158779 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.154481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:57387 (local address 127.23.229.62:41231)
0809 18:57:11.154518 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.154520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.154537 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:11.154578 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.154579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.154588 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.154658 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.154904 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.155369 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.156032 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.156234 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.156308 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.158714 (+ 2406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:57387: BlockingRecv error: recv got EOF from 127.23.229.2:57387 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 18:57:11.158867 6466 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:57:11.233994 6470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:11.234316 6470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:11.234357 6470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:11.235543 6470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:11.235589 6470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:11.235615 6470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:57:11.237201 6470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/krb5kdc/oryx_127.23.229.3.keytab
--principal=oryx/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:35891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=43149
--tserver_master_addrs=127.23.229.62:41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:11.237466 6470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:11.237705 6470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:57:11.243100 6470 server_base.cc:1034] running on GCE node
W20260809 18:57:11.243086 6477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:11.243209 6478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:11.243070 6481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:11.243533 6470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:11.243831 6470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:11.244974 6470 hybrid_clock.cc:648] HybridClock initialized: now 1786301831244948 us; error 42 us; skew 500 ppm
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301831, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:11.247421 6470 init.cc:377] Logged in from keytab as oryx/127.23.229.3@KRBTEST.COM (short username oryx)
I20260809 18:57:11.247874 6470 webserver.cc:460] Webserver started at http://127.23.229.3:43149/ using document root <none> and password file <none>
I20260809 18:57:11.248129 6470 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:11.248227 6470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:11.249704 6470 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:11.250319 6494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:11.250497 6470 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:57:11.250605 6470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "edfac5f68d8b48af9e1653f6ea8dbcbf"
format_stamp: "Formatted at 2026-08-09 18:57:10 on dist-test-slave-jq4t"
server_key: "e685a40ee7cdca89843231377040eac1"
server_key_iv: "ffd4d588aeacfe1ececc974ab7134673"
server_key_version: "encryptionkey@0"
I20260809 18:57:11.251003 6470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:11.262044 6470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:11.264010 6470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:11.264189 6470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:11.264447 6470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:11.264823 6470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:11.264886 6470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:11.264930 6470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:11.264956 6470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:11.270779 6470 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:35891
I20260809 18:57:11.270895 6706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:35891 every 8 connection(s)
I20260809 18:57:11.271278 6470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:11.272724 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 6470
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:11.280951 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.272123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:51145 (local address 127.23.229.62:41231)
0809 18:57:11.272195 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.272197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.272421 (+ 224us) server_negotiation.cc:407] Connection header received
0809 18:57:11.273099 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.273102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.273118 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.273190 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.274592 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.275596 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.277075 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.277362 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.277447 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.280885 (+ 3438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:51145: BlockingRecv error: recv got EOF from 127.23.229.3:51145 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:57:11.281018 6710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.272103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:51145)
0809 18:57:11.272294 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.272331 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.272977 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.273281 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.273286 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.274175 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.274471 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.274478 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.275689 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.275691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.276991 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.276994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.277474 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.277475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.277606 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.278155 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.278163 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.280776 (+ 2613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
W20260809 18:57:11.281250 6707 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:41231 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.229.62:41231: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
I20260809 18:57:11.281819 6218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.273296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58954 (local address 127.23.229.62:41231)
0809 18:57:11.273344 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.273347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.273438 (+ 91us) server_negotiation.cc:407] Connection header received
0809 18:57:11.273521 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.273522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.273532 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.273570 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.274416 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.274994 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.276016 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.276263 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.276337 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.277939 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:11.277944 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:11.277945 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:11.277959 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:11.280046 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:11.280514 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:11.280518 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:11.280518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:11.280628 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:11.280868 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:11.280869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:11.280869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:11.281186 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:11.281326 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.281462 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.281705 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:11.285983 6710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.281501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:59197)
0809 18:57:11.281538 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.281548 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.281591 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.281753 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.281754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.281910 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.281986 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.281987 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.282777 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.282778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.283340 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.283342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.283688 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.283689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.283738 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.284184 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.284189 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.285934 (+ 1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":18}
W20260809 18:57:11.286115 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.281536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:59197 (local address 127.23.229.62:41231)
0809 18:57:11.281588 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.281590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.281598 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:11.281686 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.281686 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.281698 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.281748 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.282075 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.282702 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.283435 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.283616 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.283676 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.286036 (+ 2360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:59197: BlockingRecv error: recv got EOF from 127.23.229.3:59197 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:11.290218 6710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.286287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:42247)
0809 18:57:11.286330 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.286340 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.286378 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.286507 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.286508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.286633 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:11.286659 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.286660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.287271 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.287272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.287763 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.287764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.288130 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.288131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.288182 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.288614 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:11.288618 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:11.290129 (+ 1511us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 18:57:11.290274 6225 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.286329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:42247 (local address 127.23.229.62:41231)
0809 18:57:11.286367 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.286369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.286377 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:11.286429 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.286430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.286441 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.286494 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.286743 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.287191 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.287856 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.288056 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.288133 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.290208 (+ 2075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:42247: BlockingRecv error: recv got EOF from 127.23.229.3:42247 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 18:57:11.290414 6707 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 18:57:12 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:12 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:12.026891 6713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:12.022007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:54549)
0809 18:57:12.022198 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:12.022209 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:12.022287 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:12.022439 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:12.022440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:12.022615 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:12.022671 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:12.022673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.023336 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.023337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:12.023884 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:12.023885 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.024347 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.024348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:12.024405 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.025054 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:12.025060 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:12.026824 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":117,"threads_started":1}
W20260809 18:57:12.027050 6714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:12.022121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:54549 (local address 127.23.229.62:41231)
0809 18:57:12.022237 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:12.022239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:12.022269 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:57:12.022349 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:12.022350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:12.022360 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:12.022422 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:12.022736 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.023266 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.024031 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.024249 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.024330 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.026953 (+ 2623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:54549: BlockingRecv error: recv got EOF from 127.23.229.1:54549 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":62,"threads_started":1}
Aug 09 18:57:12 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:12 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:12.164354 6715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:12.159320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:35645)
0809 18:57:12.159525 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:12.159540 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:12.159643 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:12.159852 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:12.159853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:12.160043 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:12.160094 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:12.160096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.160882 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.160884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:12.161450 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:12.161452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.161828 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.161830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:12.161899 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.162378 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:12.162382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:12.164283 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":105,"threads_started":1}
W20260809 18:57:12.164552 6714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:12.159428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:35645 (local address 127.23.229.62:41231)
0809 18:57:12.159530 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:12.159532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:12.159622 (+ 90us) server_negotiation.cc:407] Connection header received
0809 18:57:12.159723 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:12.159724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:12.159739 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:12.159815 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:12.160185 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.160789 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.161546 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.161747 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.161827 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.164449 (+ 2622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:35645: BlockingRecv error: recv got EOF from 127.23.229.2:35645 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 18:57:12 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:12 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:12.296317 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:12.290883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:57367)
0809 18:57:12.291083 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:12.291100 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:12.291184 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:12.291359 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:12.291360 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:12.291555 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:12.291613 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:12.291615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.292324 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.292325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:12.292933 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:12.292934 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.293350 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.293352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:12.293419 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.294229 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:12.294234 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:12.296210 (+ 1976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":70,"threads_started":1}
W20260809 18:57:12.296382 6714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:12.291042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:57367 (local address 127.23.229.62:41231)
0809 18:57:12.291113 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:12.291115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:12.291181 (+ 66us) server_negotiation.cc:407] Connection header received
0809 18:57:12.291245 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:12.291246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:12.291263 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:12.291339 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:12.291702 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.292223 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.293030 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.293234 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.293345 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.296312 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:57367: BlockingRecv error: recv got EOF from 127.23.229.3:57367 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 18:57:13 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:13 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:13.032267 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:13.027482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:50219)
0809 18:57:13.027652 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:13.027662 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:13.027722 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:13.027899 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:13.027900 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:13.028071 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:13.028123 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:13.028125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.028866 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.028867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:13.029400 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:13.029401 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.029792 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.029793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:13.029835 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:13.030303 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:13.030307 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:13.032204 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":100,"threads_started":1}
W20260809 18:57:13.032426 6722 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:13.027547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:50219 (local address 127.23.229.62:41231)
0809 18:57:13.027663 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:13.027665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:13.027706 (+ 41us) server_negotiation.cc:407] Connection header received
0809 18:57:13.027762 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:13.027763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:13.027791 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:13.027873 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:13.028190 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.028770 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.029495 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.029715 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.029781 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:13.032317 (+ 2536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:50219: BlockingRecv error: recv got EOF from 127.23.229.1:50219 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":59,"threads_started":1}
Aug 09 18:57:13 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:13 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:13.169665 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:13.164942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:51433)
0809 18:57:13.165084 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:13.165100 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:13.165168 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:13.165286 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:13.165287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:13.165477 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:13.165535 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:13.165537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.166209 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.166210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:13.166773 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:13.166774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.167162 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.167163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:13.167217 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:13.167710 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:13.167715 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:13.169602 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
W20260809 18:57:13.169818 6722 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:13.165036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:51433 (local address 127.23.229.62:41231)
0809 18:57:13.165095 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:13.165097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:13.165169 (+ 72us) server_negotiation.cc:407] Connection header received
0809 18:57:13.165216 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:13.165217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:13.165230 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:13.165274 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:13.165596 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.166131 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.166863 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.167056 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.167111 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:13.169739 (+ 2628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:51433: BlockingRecv error: recv got EOF from 127.23.229.2:51433 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 09 18:57:13 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:13 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:13.302019 6724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:13.296935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:52669)
0809 18:57:13.297150 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:13.297165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:13.297247 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:13.297392 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:13.297393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:13.297586 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:13.297642 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:13.297643 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.298327 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.298329 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:13.298906 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:13.298908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.299274 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.299275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:13.299322 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:13.299915 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:13.299920 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:13.301957 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":102,"threads_started":1}
W20260809 18:57:13.302131 6722 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:13.297126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:52669 (local address 127.23.229.62:41231)
0809 18:57:13.297182 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:13.297184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:13.297230 (+ 46us) server_negotiation.cc:407] Connection header received
0809 18:57:13.297303 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:13.297304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:13.297317 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:13.297366 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:13.297716 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.298226 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.299001 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:13.299197 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:13.299256 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:13.302055 (+ 2799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:52669: BlockingRecv error: recv got EOF from 127.23.229.3:52669 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 09 18:57:14 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:14 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:14.041388 6726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:14.032885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:44655)
0809 18:57:14.033060 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:14.033071 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:14.033134 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:14.033307 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:14.033308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:14.033504 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:14.033558 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:14.033560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.034248 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.034249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:14.034812 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:14.034813 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.035141 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.035142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:14.035187 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:14.039177 (+ 3990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:14.039183 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:14.041296 (+ 2113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":106,"threads_started":1}
W20260809 18:57:14.041507 6729 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:14.033037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:44655 (local address 127.23.229.62:41231)
0809 18:57:14.033172 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:14.033179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:14.033187 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:14.033215 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:14.033215 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:14.033227 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:14.033291 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:14.033625 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.034166 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.034882 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.035075 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.035125 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:14.041420 (+ 6295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:44655: BlockingRecv error: recv got EOF from 127.23.229.1:44655 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
Aug 09 18:57:14 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:14 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:14.175194 6731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:14.170204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:53759)
0809 18:57:14.170361 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:14.170373 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:14.170442 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:14.170563 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:14.170564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:14.170739 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:14.170792 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:14.170794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.171462 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.171463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:14.171999 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:14.172001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.172386 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.172388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:14.172446 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:14.173024 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:14.173030 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:14.175074 (+ 2044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
W20260809 18:57:14.175251 6729 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:14.170324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:53759 (local address 127.23.229.62:41231)
0809 18:57:14.170386 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:14.170388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:14.170430 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:57:14.170493 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:14.170493 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:14.170505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:14.170550 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:14.170881 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.171391 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.172090 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.172293 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.172355 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:14.175185 (+ 2830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:53759: BlockingRecv error: recv got EOF from 127.23.229.2:53759 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 18:57:14 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:14 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:14.307444 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:14.302545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:59317)
0809 18:57:14.302719 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:14.302729 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:14.302787 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:14.302930 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:14.302931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:14.303104 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:14.303156 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:14.303157 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.303816 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.303816 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:14.304515 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:14.304518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.304884 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.304885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:14.304926 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:14.305479 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:14.305484 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:14.307326 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
W20260809 18:57:14.307487 6729 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:14.302669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:59317 (local address 127.23.229.62:41231)
0809 18:57:14.302744 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:14.302746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:14.302772 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:57:14.302850 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:14.302851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:14.302864 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:14.302918 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:14.303224 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.303744 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.304611 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:14.304809 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:14.304874 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:14.307418 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:59317: BlockingRecv error: recv got EOF from 127.23.229.3:59317 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 18:57:15 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:15 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:15.046952 6734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:15.041936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:52323)
0809 18:57:15.042065 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:15.042078 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:15.042148 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:15.042275 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:15.042276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:15.042461 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:15.042540 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:15.042542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.043284 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.043285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:15.043843 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:15.043845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.044248 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.044249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:15.044315 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:15.044837 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:15.044842 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:15.046848 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
W20260809 18:57:15.047042 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:15.042015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:52323 (local address 127.23.229.62:41231)
0809 18:57:15.042163 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:15.042165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:15.042174 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:57:15.042200 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:15.042201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:15.042213 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:15.042271 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:15.042642 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.043182 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.043943 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.044165 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.044246 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:15.046967 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:52323: BlockingRecv error: recv got EOF from 127.23.229.1:52323 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
Aug 09 18:57:15 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:15 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:15.180883 6736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:15.175770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:43751)
0809 18:57:15.175972 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:15.175985 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:15.176100 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:15.176260 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:15.176261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:15.176444 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:15.176560 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:15.176563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.177255 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.177257 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:15.177877 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:15.177880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.178224 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.178225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:15.178271 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:15.178860 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:15.178865 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:15.180799 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":113,"threads_started":1}
W20260809 18:57:15.181005 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:15.175831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43751 (local address 127.23.229.62:41231)
0809 18:57:15.175890 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:15.175892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:15.176076 (+ 184us) server_negotiation.cc:407] Connection header received
0809 18:57:15.176179 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:15.176180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:15.176193 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:15.176239 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:15.176629 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.177165 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.177961 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.178151 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.178205 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:15.180923 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:43751: BlockingRecv error: recv got EOF from 127.23.229.2:43751 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 09 18:57:15 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:15 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:15.312824 6737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:15.308069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:46201)
0809 18:57:15.308212 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:15.308225 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:15.308298 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:15.308439 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:15.308440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:15.308644 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:15.308697 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:15.308699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.309353 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.309362 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:15.309892 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:15.309893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.310299 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.310299 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:15.310344 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:15.310853 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:15.310858 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:15.312761 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
W20260809 18:57:15.313024 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:15.308147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:46201 (local address 127.23.229.62:41231)
0809 18:57:15.308247 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:15.308249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:15.308283 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:57:15.308351 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:15.308351 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:15.308364 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:15.308425 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:15.308769 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.309280 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.310009 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:15.310211 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:15.310287 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:15.312950 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:46201: BlockingRecv error: recv got EOF from 127.23.229.3:46201 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 18:57:16 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:16 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:16.053057 6738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:16.047714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:55657)
0809 18:57:16.047914 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:16.047935 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:16.048033 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:16.048240 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:16.048242 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:16.048584 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:16.048655 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.048658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.049405 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.049406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.049956 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.049957 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.050302 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.050303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.050346 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.050944 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:16.050950 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:16.052986 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":140,"threads_started":1}
W20260809 18:57:16.053213 6739 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:16.047895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:55657 (local address 127.23.229.62:41231)
0809 18:57:16.048050 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:16.048053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:16.048064 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:57:16.048095 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:16.048096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:16.048111 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:16.048204 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:16.048765 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.049309 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.050032 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.050232 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.050286 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.053100 (+ 2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:55657: BlockingRecv error: recv got EOF from 127.23.229.1:55657 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
Aug 09 18:57:16 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:16 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:16.186390 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:16.181476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:44845)
0809 18:57:16.181659 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:16.181673 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:16.181733 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:16.181886 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:16.181887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:16.182066 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:16.182120 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.182122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.182834 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.182835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.183383 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.183384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.183737 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.183738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.183783 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.184294 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:16.184299 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:16.186317 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":119,"threads_started":1}
W20260809 18:57:16.186523 6739 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:16.181649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:44845 (local address 127.23.229.62:41231)
0809 18:57:16.181708 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:16.181710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:16.181720 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:16.181797 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:16.181798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:16.181810 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:16.181857 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:16.182199 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.182734 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.183469 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.183661 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.183719 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.186429 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:44845: BlockingRecv error: recv got EOF from 127.23.229.2:44845 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 18:57:16 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:16 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:16.318408 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:16.313387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:58873)
0809 18:57:16.313559 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:16.313571 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:16.313629 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:16.313771 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:16.313772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:16.313969 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:16.314021 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.314022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.314746 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.314748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.315302 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.315304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.315631 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.315632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.315676 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.316183 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:16.316187 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:16.318330 (+ 2143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
W20260809 18:57:16.318506 6739 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:16.313500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:58873 (local address 127.23.229.62:41231)
0809 18:57:16.313578 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:16.313580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:16.313614 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:57:16.313690 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:16.313690 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:16.313708 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:16.313754 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:16.314133 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.314651 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.315382 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.315564 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.315615 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.318432 (+ 2817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:58873: BlockingRecv error: recv got EOF from 127.23.229.3:58873 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 18:57:17 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:17 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:17.059286 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.053682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:45783)
0809 18:57:17.053875 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:17.053913 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:17.054000 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:17.054249 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:17.054251 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:17.054495 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:17.054555 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.054557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.055462 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.055463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.056083 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.056085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.056546 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.056548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.056603 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.057160 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:17.057165 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:17.059222 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":87,"threads_started":1}
W20260809 18:57:17.059449 6743 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:17.053809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:45783 (local address 127.23.229.62:41231)
0809 18:57:17.053979 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:17.053981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:17.053991 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:17.054081 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:17.054082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:17.054100 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:17.054167 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:17.054675 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.055353 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.056184 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.056395 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.056464 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.059354 (+ 2890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:45783: BlockingRecv error: recv got EOF from 127.23.229.1:45783 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":77,"threads_started":1}
Aug 09 18:57:17 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:17 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:17.192201 6744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.186973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:39843)
0809 18:57:17.187262 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:17.187276 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:17.187369 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:17.187518 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:17.187519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:17.187718 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:17.187784 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.187785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.188533 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.188534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.189080 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.189082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.189476 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.189477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.189563 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.190082 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:17.190092 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:17.192137 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":103,"threads_started":1}
W20260809 18:57:17.192373 6743 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:17.187084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:39843 (local address 127.23.229.62:41231)
0809 18:57:17.187266 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:17.187269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:17.187349 (+ 80us) server_negotiation.cc:407] Connection header received
0809 18:57:17.187439 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:17.187440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:17.187453 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:17.187501 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:17.187868 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.188390 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.189168 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.189375 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.189473 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.192277 (+ 2804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:39843: BlockingRecv error: recv got EOF from 127.23.229.2:39843 (error 108)
Metrics: {"server-negotiator.queue_time_us":149}
Aug 09 18:57:17 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:17 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:17.323958 6747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.318979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:55721)
0809 18:57:17.319176 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:17.319197 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:17.319261 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:17.319408 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:17.319408 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:17.319594 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:17.319647 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.319648 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.320312 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.320313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.320912 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.320914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.321253 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.321254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.321295 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.321773 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:17.321777 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:17.323891 (+ 2114us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":143,"threads_started":1}
W20260809 18:57:17.324153 6743 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:17.319109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:55721 (local address 127.23.229.62:41231)
0809 18:57:17.319169 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:17.319170 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:17.319265 (+ 95us) server_negotiation.cc:407] Connection header received
0809 18:57:17.319326 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:17.319327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:17.319341 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:17.319386 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:17.319714 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.320240 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.320986 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.321182 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.321239 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.324066 (+ 2827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:55721: BlockingRecv error: recv got EOF from 127.23.229.3:55721 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 09 18:57:18 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:18 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:18.064821 6748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:18.059938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:50867)
0809 18:57:18.060128 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:18.060140 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:18.060195 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:18.060348 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:18.060349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:18.060593 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:18.060651 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:18.060653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.061327 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.061327 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:18.061856 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:18.061857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.062211 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.062212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:18.062257 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.062835 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:18.062841 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:18.064756 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":120,"threads_started":1}
W20260809 18:57:18.065002 6749 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:18.060035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:50867 (local address 127.23.229.62:41231)
0809 18:57:18.060185 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:18.060187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:18.060198 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:57:18.060247 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:18.060247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:18.060260 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:18.060327 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:18.060718 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.061253 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.061934 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.062139 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.062199 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.064881 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:50867: BlockingRecv error: recv got EOF from 127.23.229.1:50867 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
Aug 09 18:57:18 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:18 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:18.198225 6750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:18.192833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:56557)
0809 18:57:18.193079 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:18.193101 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:18.193190 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:18.193364 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:18.193365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:18.193583 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:18.193638 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:18.193639 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.194388 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.194390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:18.194953 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:18.194955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.195341 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.195342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:18.195406 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.195966 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:18.195971 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:18.198117 (+ 2146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":126,"threads_started":1}
W20260809 18:57:18.198347 6749 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:18.192970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:56557 (local address 127.23.229.62:41231)
0809 18:57:18.193067 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:18.193070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:18.193183 (+ 113us) server_negotiation.cc:407] Connection header received
0809 18:57:18.193257 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:18.193258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:18.193279 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:18.193354 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:18.193753 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.194294 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.195052 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.195258 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.195341 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.198265 (+ 2924us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:56557: BlockingRecv error: recv got EOF from 127.23.229.2:56557 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 18:57:18 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:18 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:18.330053 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:18.324602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:50875)
0809 18:57:18.324959 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:18.324971 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:18.325074 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:18.325251 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:18.325252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:18.325459 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:18.325516 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:18.325518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.326241 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.326242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:18.326788 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:18.326790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.327193 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.327195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:18.327255 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.327832 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:18.327837 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:18.329948 (+ 2111us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":127,"threads_started":1}
W20260809 18:57:18.330099 6749 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:18.324732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:50875 (local address 127.23.229.62:41231)
0809 18:57:18.324924 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:18.324927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:18.325049 (+ 122us) server_negotiation.cc:407] Connection header received
0809 18:57:18.325144 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:18.325145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:18.325161 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:18.325240 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:18.325610 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.326141 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.326898 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.327107 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.327191 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.330031 (+ 2840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:50875: BlockingRecv error: recv got EOF from 127.23.229.3:50875 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
Aug 09 18:57:19 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.072968 6752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.065410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:36645)
0809 18:57:19.065579 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.065591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.065646 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.065805 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.065806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.066014 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.066066 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.066068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.066747 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.066748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.067307 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.067308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.067666 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.067667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.067711 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.070849 (+ 3138us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.070854 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.072872 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
W20260809 18:57:19.073212 6754 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.065544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:36645 (local address 127.23.229.62:41231)
0809 18:57:19.065678 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.065679 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.065688 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:57:19.065711 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.065711 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.065723 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.065785 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.066138 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.066655 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.067393 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.067595 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.067648 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.073118 (+ 5470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:36645: BlockingRecv error: recv got EOF from 127.23.229.1:36645 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
Aug 09 18:57:19 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.204254 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.198982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:41435)
0809 18:57:19.199159 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.199170 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.199231 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.199387 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.199388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.199567 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.199620 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.199621 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.200447 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.200448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.201021 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.201022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.201420 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.201421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.201463 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.202022 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.202027 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.204189 (+ 2162us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":105,"threads_started":1}
W20260809 18:57:19.204450 6754 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.199090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:41435 (local address 127.23.229.62:41231)
0809 18:57:19.199169 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.199171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.199217 (+ 46us) server_negotiation.cc:407] Connection header received
0809 18:57:19.199301 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.199301 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.199314 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.199359 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.199689 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.200357 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.201138 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.201342 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.201408 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.204376 (+ 2968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:41435: BlockingRecv error: recv got EOF from 127.23.229.2:41435 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 18:57:19 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.336087 6757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.330781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:45661)
0809 18:57:19.330979 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.330990 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.331045 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.331635 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.331636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.331816 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.331872 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.331873 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.332588 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.332588 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.333128 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.333130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.333453 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.333453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.333495 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.334001 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.334006 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.336020 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":111,"threads_started":1}
W20260809 18:57:19.336285 6754 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.331433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:45661 (local address 127.23.229.62:41231)
0809 18:57:19.331498 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.331500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.331508 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:19.331534 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.331535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.331548 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.331605 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.331948 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.332465 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.333203 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.333386 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.333440 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.336169 (+ 2729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:45661: BlockingRecv error: recv got EOF from 127.23.229.3:45661 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 09 18:57:20 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:20.079175 6759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.073640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:40357)
0809 18:57:20.073794 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.073806 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.073863 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.074101 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.074102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.074402 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.074500 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.074504 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.075342 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.075343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.075944 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.075946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.076506 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.076508 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.076577 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.077062 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.077067 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.079111 (+ 2044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
W20260809 18:57:20.079326 6760 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.073753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:40357 (local address 127.23.229.62:41231)
0809 18:57:20.073909 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.073911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.073920 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:57:20.073946 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.073947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.073962 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.074056 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.074592 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.075264 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.076096 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.076406 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.076462 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.079228 (+ 2766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:40357: BlockingRecv error: recv got EOF from 127.23.229.1:40357 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
Aug 09 18:57:20 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:20.210189 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.204918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:36501)
0809 18:57:20.205078 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.205099 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.205158 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.205383 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.205384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.205568 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.205627 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.205629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.206330 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.206332 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.207033 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.207037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.207526 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.207527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.207578 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.208073 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.208078 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.210125 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
W20260809 18:57:20.210345 6760 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.205111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:36501 (local address 127.23.229.62:41231)
0809 18:57:20.205189 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.205191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.205201 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:20.205232 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.205233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.205245 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.205316 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.205711 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.206239 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.207157 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.207457 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.207513 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.210258 (+ 2745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:36501: BlockingRecv error: recv got EOF from 127.23.229.2:36501 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 18:57:20 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:20.342370 6762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.336765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:34295)
0809 18:57:20.336991 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.337001 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.337081 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.337257 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.337258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.337468 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.337523 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.337524 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.338272 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.338274 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.339146 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.339149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.339596 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.339597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.339648 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.340245 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.340251 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.342306 (+ 2055us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":124,"threads_started":1}
W20260809 18:57:20.342533 6760 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.336854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:34295 (local address 127.23.229.62:41231)
0809 18:57:20.336934 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.336937 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.337061 (+ 124us) server_negotiation.cc:407] Connection header received
0809 18:57:20.337154 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.337155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.337171 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.337248 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.337612 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.338179 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.339254 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.339483 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.339548 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.342437 (+ 2889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:34295: BlockingRecv error: recv got EOF from 127.23.229.3:34295 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 18:57:21 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:21 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:21.085086 6767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:21.079841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:49667)
0809 18:57:21.080027 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:21.080039 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:21.080111 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:21.080263 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:21.080263 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:21.080439 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:21.080513 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.080514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.081188 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.081189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.081717 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.081718 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.082113 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.082114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.082157 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.082677 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:21.082682 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:21.084966 (+ 2284us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":78,"threads_started":1}
W20260809 18:57:21.085158 6768 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:21.079888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:49667 (local address 127.23.229.62:41231)
0809 18:57:21.080033 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:21.080035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:21.080111 (+ 76us) server_negotiation.cc:407] Connection header received
0809 18:57:21.080174 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:21.080175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:21.080187 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:21.080239 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:21.080581 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.081118 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.081805 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.082029 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.082103 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.085080 (+ 2977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:49667: BlockingRecv error: recv got EOF from 127.23.229.1:49667 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
Aug 09 18:57:21 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:21 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:21.215790 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:21.210928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:48979)
0809 18:57:21.211125 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:21.211142 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:21.211194 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:21.211344 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:21.211345 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:21.211532 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:21.211588 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.211590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.212303 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.212305 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.212926 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.212929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.213276 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.213277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.213321 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.213824 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:21.213845 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:21.215696 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":129,"threads_started":1}
W20260809 18:57:21.215886 6768 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:21.211049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:48979 (local address 127.23.229.62:41231)
0809 18:57:21.211160 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:21.211163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:21.211218 (+ 55us) server_negotiation.cc:407] Connection header received
0809 18:57:21.211253 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:21.211254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:21.211268 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:21.211321 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:21.211662 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.212201 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.213010 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.213205 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.213262 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.215814 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:48979: BlockingRecv error: recv got EOF from 127.23.229.2:48979 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 18:57:21 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:21 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:21.347755 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:21.342941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:60505)
0809 18:57:21.343141 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:21.343153 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:21.343212 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:21.343368 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:21.343369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:21.343545 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:21.343598 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.343599 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.344268 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.344268 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.344822 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.344824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.345150 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.345151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.345192 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.345731 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:21.345736 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:21.347683 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":119,"threads_started":1}
W20260809 18:57:21.347829 6768 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:21.343100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:60505 (local address 127.23.229.62:41231)
0809 18:57:21.343186 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:21.343188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:21.343199 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:57:21.343279 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:21.343280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:21.343294 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:21.343346 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:21.343665 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.344196 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.344893 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.345083 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.345135 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.347778 (+ 2643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:60505: BlockingRecv error: recv got EOF from 127.23.229.3:60505 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 18:57:22 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:22 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:22.091101 6773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:22.085706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:51395)
0809 18:57:22.085919 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:22.085932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:22.086016 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:22.086217 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:22.086218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:22.086519 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:22.086587 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.086590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.087294 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.087296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.087851 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.087853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.088189 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.088190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.088233 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.088774 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:22.088779 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:22.090978 (+ 2199us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":123,"threads_started":1}
W20260809 18:57:22.091169 6775 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:22.085872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:51395 (local address 127.23.229.62:41231)
0809 18:57:22.086048 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:22.086050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:22.086061 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:57:22.086090 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:22.086091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:22.086111 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:22.086180 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:22.086679 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.087198 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.087929 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.088122 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.088173 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.091086 (+ 2913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:51395: BlockingRecv error: recv got EOF from 127.23.229.1:51395 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
Aug 09 18:57:22 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:22 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:22.221627 6777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:22.216579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:52865)
0809 18:57:22.216789 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:22.216799 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:22.216838 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:22.217068 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:22.217069 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:22.217274 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:22.217327 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.217329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.218147 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.218149 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.218690 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.218692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.219082 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.219083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.219148 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.219631 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:22.219635 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:22.221556 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":122,"threads_started":1}
W20260809 18:57:22.221812 6775 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:22.216648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:52865 (local address 127.23.229.62:41231)
0809 18:57:22.216731 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:22.216733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:22.216925 (+ 192us) server_negotiation.cc:407] Connection header received
0809 18:57:22.216964 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:22.216965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:22.216979 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:22.217044 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:22.217416 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.218060 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.218786 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.218989 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.219080 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.221740 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:52865: BlockingRecv error: recv got EOF from 127.23.229.2:52865 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 18:57:22 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:22 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:22.353528 6779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:22.348344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:42985)
0809 18:57:22.348583 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:22.348594 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:22.348685 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:22.348863 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:22.348864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:22.349086 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:22.349139 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.349141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.349866 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.349868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.350416 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.350418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.350818 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.350819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.350881 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.351388 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:22.351393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:22.353423 (+ 2030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":68,"threads_started":1}
W20260809 18:57:22.353653 6775 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:22.348453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:42985 (local address 127.23.229.62:41231)
0809 18:57:22.348531 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:22.348534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:22.348664 (+ 130us) server_negotiation.cc:407] Connection header received
0809 18:57:22.348759 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:22.348760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:22.348783 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:22.348853 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:22.349239 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.349770 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.350540 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.350731 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.350819 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.353556 (+ 2737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:42985: BlockingRecv error: recv got EOF from 127.23.229.3:42985 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 18:57:23 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:23 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:23.096777 6780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:23.091736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:57787)
0809 18:57:23.091932 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:23.091944 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:23.092015 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:23.092194 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:23.092195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:23.092385 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:23.092437 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.092439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.093234 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.093236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.093790 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.093792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.094138 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.094139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.094184 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.094671 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:23.094676 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:23.096714 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":117,"threads_started":1}
W20260809 18:57:23.096967 6781 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:23.091855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:57787 (local address 127.23.229.62:41231)
0809 18:57:23.092008 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:23.092010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:23.092020 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:23.092070 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:23.092070 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:23.092083 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:23.092144 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:23.092553 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.093155 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.093869 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.094070 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.094120 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.096866 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:57787: BlockingRecv error: recv got EOF from 127.23.229.1:57787 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
Aug 09 18:57:23 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:23 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:23.227315 6782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:23.222243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:50529)
0809 18:57:23.222416 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:23.222428 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:23.222489 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:23.222657 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:23.222657 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:23.222846 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:23.222905 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.222907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.223590 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.223592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.224142 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.224144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.224587 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.224588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.224644 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.225151 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:23.225155 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:23.227216 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":99,"threads_started":1}
W20260809 18:57:23.227659 6781 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:23.222353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:50529 (local address 127.23.229.62:41231)
0809 18:57:23.222460 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:23.222466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:23.222478 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:57:23.222560 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:23.222560 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:23.222574 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:23.222637 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:23.222987 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.223505 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.224228 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.224428 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.224545 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.227354 (+ 2809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:50529: BlockingRecv error: recv got EOF from 127.23.229.2:50529 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 18:57:23 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:23 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:23.359519 6783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:23.353996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:45615)
0809 18:57:23.354196 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:23.354207 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:23.354305 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:23.354485 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:23.354486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:23.354693 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:23.354743 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.354745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.355567 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.355568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.356377 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.356379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.356881 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.356883 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.356943 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.357460 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:23.357465 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:23.359416 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":115,"threads_started":1}
W20260809 18:57:23.359568 6781 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:23.354104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:45615 (local address 127.23.229.62:41231)
0809 18:57:23.354183 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:23.354186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:23.354283 (+ 97us) server_negotiation.cc:407] Connection header received
0809 18:57:23.354379 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:23.354380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:23.354396 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:23.354465 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:23.354843 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.355473 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.356512 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.356773 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.356878 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.359499 (+ 2621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:45615: BlockingRecv error: recv got EOF from 127.23.229.3:45615 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 18:57:24 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:24 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:24.105607 6786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:24.097344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:44289)
0809 18:57:24.097521 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:24.097534 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:24.097632 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:24.097847 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:24.097848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:24.098113 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:24.098185 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.098189 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.098949 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.098950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.099535 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.099537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.099895 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.099896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.099943 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.103353 (+ 3410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:24.103358 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:24.105529 (+ 2171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":103,"threads_started":1}
W20260809 18:57:24.105774 6787 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:24.097490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:44289 (local address 127.23.229.62:41231)
0809 18:57:24.097628 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:24.097630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:24.097639 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:57:24.097703 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:24.097704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:24.097720 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:24.097796 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:24.098284 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.098828 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.099617 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.099813 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.099866 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.105672 (+ 5806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:44289: BlockingRecv error: recv got EOF from 127.23.229.1:44289 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":56,"threads_started":1}
Aug 09 18:57:24 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:24 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:24.233247 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:24.228040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:53025)
0809 18:57:24.228218 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:24.228231 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:24.228294 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:24.228497 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:24.228498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:24.228682 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:24.228736 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.228738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.229624 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.229626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.230173 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.230175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.230587 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.230588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.230658 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.231189 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:24.231194 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:24.233183 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":112,"threads_started":1}
W20260809 18:57:24.233419 6787 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:24.228250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:53025 (local address 127.23.229.62:41231)
0809 18:57:24.228328 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:24.228331 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:24.228339 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:57:24.228371 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:24.228372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:24.228384 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:24.228455 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:24.228840 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.229526 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.230264 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.230491 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.230584 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.233334 (+ 2750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:53025: BlockingRecv error: recv got EOF from 127.23.229.2:53025 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 18:57:24 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:24 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:24.365259 6794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:24.360084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:44339)
0809 18:57:24.360271 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:24.360283 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:24.360355 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:24.360627 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:24.360628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:24.360833 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:24.360885 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.360887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.361592 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.361593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.362170 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.362172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.362558 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.362559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.362621 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.363161 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:24.363166 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:24.365147 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":78,"threads_started":1}
W20260809 18:57:24.365319 6787 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:24.360202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:44339 (local address 127.23.229.62:41231)
0809 18:57:24.360274 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:24.360276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:24.360335 (+ 59us) server_negotiation.cc:407] Connection header received
0809 18:57:24.360413 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:24.360414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:24.360432 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:24.360611 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:24.360971 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.361499 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.362272 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.362472 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.362556 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.365249 (+ 2693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:44339: BlockingRecv error: recv got EOF from 127.23.229.3:44339 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 09 18:57:25 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:25 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:25.111447 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:25.106198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:58979)
0809 18:57:25.106369 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:25.106380 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:25.106438 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:25.106601 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:25.106602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:25.106791 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:25.106845 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.106847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.107513 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.107514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.108072 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.108074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.108674 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.108675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.108740 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.109303 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:25.109309 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:25.111344 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
W20260809 18:57:25.111529 6800 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:25.106267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:58979 (local address 127.23.229.62:41231)
0809 18:57:25.106420 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:25.106422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:25.106433 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:57:25.106501 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:25.106502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:25.106515 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:25.106584 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:25.106909 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.107437 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.108247 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.108586 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.108652 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.111455 (+ 2803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:58979: BlockingRecv error: recv got EOF from 127.23.229.1:58979 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
Aug 09 18:57:25 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:25 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:25.238701 6802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:25.233778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:50441)
0809 18:57:25.233986 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:25.234000 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:25.234074 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:25.234221 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:25.234221 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:25.234433 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:25.234487 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.234489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.235226 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.235228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.235794 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.235795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.236176 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.236178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.236238 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.236731 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:25.236735 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:25.238597 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":116,"threads_started":1}
W20260809 18:57:25.238762 6800 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:25.233900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:50441 (local address 127.23.229.62:41231)
0809 18:57:25.233990 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:25.233993 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:25.234067 (+ 74us) server_negotiation.cc:407] Connection header received
0809 18:57:25.234137 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:25.234138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:25.234152 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:25.234200 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:25.234588 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.235123 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.235884 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.236098 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.236179 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.238693 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:50441: BlockingRecv error: recv got EOF from 127.23.229.2:50441 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 18:57:25 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:25 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.3@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:25.370996 6803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:25.365825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.3:40655)
0809 18:57:25.366030 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:25.366045 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:25.366122 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:25.366304 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:25.366305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:25.366518 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:25.366577 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.366579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.367295 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.367297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.367846 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.367848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.368233 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.368234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.368296 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.368842 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:25.368847 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:25.370935 (+ 2088us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":84,"threads_started":1}
W20260809 18:57:25.371150 6800 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:25.365962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:40655 (local address 127.23.229.62:41231)
0809 18:57:25.366083 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:25.366086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:25.366100 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:57:25.366194 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:25.366195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:25.366218 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:25.366293 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:25.366673 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.367198 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.367944 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.368153 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.368233 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.371065 (+ 2832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.3:40655: BlockingRecv error: recv got EOF from 127.23.229.3:40655 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 18:57:26 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:26 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.1@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:26.117594 6806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.112131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.1:39483)
0809 18:57:26.112311 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.112330 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.112386 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.112578 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.112578 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.112779 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.112858 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.112859 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.113531 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.113532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.114160 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.114162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.114602 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.114603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.114656 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.115292 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:26.115297 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.117483 (+ 2186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":109,"threads_started":1}
W20260809 18:57:26.117652 6807 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:26.112222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:39483 (local address 127.23.229.62:41231)
0809 18:57:26.112362 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.112364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.112374 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:26.112452 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.112453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.112465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.112559 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.112930 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.113450 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.114272 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.114521 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.114585 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.117575 (+ 2990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.1:39483: BlockingRecv error: recv got EOF from 127.23.229.1:39483 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
Aug 09 18:57:26 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:26 dist-test-slave-jq4t krb5kdc[4833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.229.2@KRBTEST.COM for oryx/127.23.229.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:26.244395 6808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.239380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41231 (local address 127.23.229.2:59499)
0809 18:57:26.239560 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.239580 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.239644 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.239808 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.239809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.240015 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.240064 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.240065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.240905 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.240906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.241447 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.241449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.241866 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.241867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.241937 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.242398 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:26.242402 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.244284 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.229.62:41231: Server oryx/127.23.229.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":122,"threads_started":1}
W20260809 18:57:26.244462 6807 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:26.239519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:59499 (local address 127.23.229.62:41231)
0809 18:57:26.239593 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.239594 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.239625 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:57:26.239701 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.239702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.239714 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.239794 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.240158 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.240825 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.241558 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.241778 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.241856 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.244397 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.229.2:59499: BlockingRecv error: recv got EOF from 127.23.229.2:59499 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:57:26.280580 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 5922
I20260809 18:57:26.295303 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 6222
I20260809 18:57:26.307461 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 6470
I20260809 18:57:26.317070 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 5798
2026-08-09T18:57:26Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17825 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T18:57:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:26Z Disabled control of system clock
I20260809 18:57:26.353757 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38035
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:38279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:38035
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 18:57:26.438378 6813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:26.438619 6813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:26.438642 6813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:26.439900 6813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:26.439949 6813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:26.439961 6813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:26.439975 6813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:26.439986 6813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:26.441447 6813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:38035
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:26.441735 6813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:26.442080 6813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:26.447721 6827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:26.447754 6813 server_base.cc:1034] running on GCE node
W20260809 18:57:26.447721 6824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:26.447760 6825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:26.448309 6813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:26.448804 6813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:26.450019 6813 hybrid_clock.cc:648] HybridClock initialized: now 1786301846449990 us; error 56 us; skew 500 ppm
I20260809 18:57:26.451615 6813 webserver.cc:460] Webserver started at http://127.23.229.62:44257/ using document root <none> and password file <none>
I20260809 18:57:26.451910 6813 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:26.451995 6813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:26.452162 6813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:26.453414 6813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "94ff706886d7417a8a0b6bd6739ad035"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "9dd2457230512caf959daa1e8c5b353f"
server_key_iv: "50cdca39cd1c003bc41d0546d4b338ab"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.453809 6813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "94ff706886d7417a8a0b6bd6739ad035"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "9dd2457230512caf959daa1e8c5b353f"
server_key_iv: "50cdca39cd1c003bc41d0546d4b338ab"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.455235 6813 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:57:26.456041 6836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.456255 6813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:26.456380 6813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "94ff706886d7417a8a0b6bd6739ad035"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "9dd2457230512caf959daa1e8c5b353f"
server_key_iv: "50cdca39cd1c003bc41d0546d4b338ab"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.456459 6813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:26.467882 6813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:26.468240 6813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:26.468415 6813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:26.473031 6813 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:38035
I20260809 18:57:26.473073 6923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:38035 every 8 connection(s)
I20260809 18:57:26.473479 6813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:26.474248 6924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:26.477351 6924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035: Bootstrap starting.
I20260809 18:57:26.477977 6924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:26.478256 6924 log.cc:824] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:26.479013 6924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035: No bootstrap required, opened a new log
I20260809 18:57:26.479158 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 6813
I20260809 18:57:26.479277 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:57:26.479507 24468 external_mini_cluster.cc:1428] Setting key b7f86f581a7b0685bfb78034a6711f15
I20260809 18:57:26.481504 6924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ff706886d7417a8a0b6bd6739ad035" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38035 } }
I20260809 18:57:26.481704 6924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:26.481750 6924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ff706886d7417a8a0b6bd6739ad035, State: Initialized, Role: FOLLOWER
I20260809 18:57:26.481940 6924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ff706886d7417a8a0b6bd6739ad035" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38035 } }
I20260809 18:57:26.482059 6924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:26.482097 6924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:26.482152 6924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:26.482980 6924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ff706886d7417a8a0b6bd6739ad035" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38035 } }
I20260809 18:57:26.483105 6924 leader_election.cc:302] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94ff706886d7417a8a0b6bd6739ad035; no voters:
I20260809 18:57:26.483271 6924 leader_election.cc:288] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:26.483505 6935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:26.483690 6935 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [term 1 LEADER]: Becoming Leader. State: Replica: 94ff706886d7417a8a0b6bd6739ad035, State: Running, Role: LEADER
I20260809 18:57:26.483745 6924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:26.483871 6935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ff706886d7417a8a0b6bd6739ad035" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38035 } }
I20260809 18:57:26.484301 6935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94ff706886d7417a8a0b6bd6739ad035. Latest consensus state: current_term: 1 leader_uuid: "94ff706886d7417a8a0b6bd6739ad035" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ff706886d7417a8a0b6bd6739ad035" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38035 } } }
I20260809 18:57:26.484591 6935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:26.484509 6939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94ff706886d7417a8a0b6bd6739ad035" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ff706886d7417a8a0b6bd6739ad035" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38035 } } }
I20260809 18:57:26.485023 6939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035 [sys.catalog]: This master's current role is: LEADER
W20260809 18:57:26.485628 6967 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:57:26.485687 6967 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:57:26.485730 6952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:26.485881 6952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:26.487699 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.480127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47904 (local address 127.23.229.62:38035)
0809 18:57:26.480333 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.480341 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.480367 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:57:26.481482 (+ 1115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.481491 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.481557 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.481682 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.482022 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.484006 (+ 1984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.485363 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.485899 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.486050 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.486912 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:26.486917 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:26.486917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:26.487156 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:26.487204 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:26.487221 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:26.487295 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:26.487380 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 18:57:26.487464 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260809 18:57:26.487706 6952 catalog_manager.cc:1347] Generated new cluster ID: b930095e87db4c29b33b9527bbd2e76e
I20260809 18:57:26.487921 6952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:26.496726 6952 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:26.497488 6952 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:26.506350 6952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94ff706886d7417a8a0b6bd6739ad035: Generated new TSK 0
I20260809 18:57:26.506646 6952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:57:26.509053 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38035
--builtin_ntp_servers=127.23.229.20:38279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 18:57:26.622321 6973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:26.622529 6973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:26.622551 6973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:26.623708 6973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:26.623751 6973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:26.623775 6973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:57:26.625213 6973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:26.625483 6973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:26.625804 6973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:26.631868 6985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:26.631888 6984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:26.631889 6989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:26.632222 6973 server_base.cc:1034] running on GCE node
I20260809 18:57:26.632412 6973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:26.632668 6973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:26.633857 6973 hybrid_clock.cc:648] HybridClock initialized: now 1786301846633840 us; error 32 us; skew 500 ppm
I20260809 18:57:26.635306 6973 webserver.cc:460] Webserver started at http://127.23.229.1:42953/ using document root <none> and password file <none>
I20260809 18:57:26.635591 6973 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:26.635658 6973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:26.635802 6973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:26.637032 6973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "e2b903c40a7e40f7b7eb16da9eb0ce4f"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "860b4f16befecff6de9a7d30af7a3058"
server_key_iv: "82bbd439256f5cb810374af98f796a60"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.637408 6973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "e2b903c40a7e40f7b7eb16da9eb0ce4f"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "860b4f16befecff6de9a7d30af7a3058"
server_key_iv: "82bbd439256f5cb810374af98f796a60"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.638773 6973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:57:26.639598 6999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.639786 6973 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:26.639914 6973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "e2b903c40a7e40f7b7eb16da9eb0ce4f"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "860b4f16befecff6de9a7d30af7a3058"
server_key_iv: "82bbd439256f5cb810374af98f796a60"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.639993 6973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:26.653664 6973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:26.654007 6973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:26.654160 6973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:26.654393 6973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:26.654747 6973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:26.654799 6973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.654851 6973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:26.654878 6973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.661144 6973 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:40063
I20260809 18:57:26.661187 7188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:40063 every 8 connection(s)
I20260809 18:57:26.661525 6973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:26.665998 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 6973
I20260809 18:57:26.666087 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:26.666317 24468 external_mini_cluster.cc:1428] Setting key ac21653c94d4e5dcf4b0571a85501a72
I20260809 18:57:26.666843 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.662243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:52185 (local address 127.23.229.62:38035)
0809 18:57:26.662295 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.662297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.662574 (+ 277us) server_negotiation.cc:407] Connection header received
0809 18:57:26.663063 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.663064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.663076 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.663125 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.663770 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.664269 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.665339 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.665537 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.665604 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.666557 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:26.666559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:26.666559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:26.666564 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:26.666581 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:26.666585 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:26.666638 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:26.666754 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 18:57:26.666778 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:57:26.667104 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.662247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38035 (local address 127.23.229.1:52185)
0809 18:57:26.662453 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.662487 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.662982 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.663192 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.663196 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.663204 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.663702 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.663706 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.664367 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.664368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.665233 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.665236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.665624 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.665625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.665738 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.666375 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:26.666375 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.666427 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:26.666455 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:26.666657 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:26.666666 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:26.666669 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:26.666752 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:57:26.666858 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":93,"threads_started":1}
I20260809 18:57:26.667359 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38035
--builtin_ntp_servers=127.23.229.20:38279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 18:57:26.667722 7190 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38035
I20260809 18:57:26.667824 7190 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:26.668018 7190 heartbeater.cc:511] Master 127.23.229.62:38035 requested a full tablet report, sending...
I20260809 18:57:26.668583 6866 ts_manager.cc:194] Registered new tserver with Master: e2b903c40a7e40f7b7eb16da9eb0ce4f (127.23.229.1:40063)
I20260809 18:57:26.669413 6866 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.1:52185
W20260809 18:57:26.752202 7195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:26.752460 7195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:26.752496 7195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:26.753672 7195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:26.753743 7195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:26.753787 7195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:57:26.755156 7195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:26.755430 7195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:26.755734 7195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:26.761032 7203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:26.760998 7205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:26.760998 7207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:26.761358 7195 server_base.cc:1034] running on GCE node
I20260809 18:57:26.761591 7195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:26.761866 7195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:26.763025 7195 hybrid_clock.cc:648] HybridClock initialized: now 1786301846763008 us; error 33 us; skew 500 ppm
I20260809 18:57:26.764366 7195 webserver.cc:460] Webserver started at http://127.23.229.2:44391/ using document root <none> and password file <none>
I20260809 18:57:26.764644 7195 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:26.764698 7195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:26.764869 7195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:26.765988 7195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "9b4fb0a1e1164db481eb38406f52b19f"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "84de8b3a4205f5af04c1f48430210640"
server_key_iv: "f66d6a9a2638a1570dbdc9694872f87a"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.766361 7195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "9b4fb0a1e1164db481eb38406f52b19f"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "84de8b3a4205f5af04c1f48430210640"
server_key_iv: "f66d6a9a2638a1570dbdc9694872f87a"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.767704 7195 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:57:26.768425 7220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.768626 7195 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:57:26.768729 7195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "9b4fb0a1e1164db481eb38406f52b19f"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "84de8b3a4205f5af04c1f48430210640"
server_key_iv: "f66d6a9a2638a1570dbdc9694872f87a"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.768811 7195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:26.777324 7195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:26.777611 7195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:26.777750 7195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:26.777976 7195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:26.778301 7195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:26.778352 7195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.778395 7195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:26.778424 7195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.784124 7195 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:46859
I20260809 18:57:26.784195 7403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:46859 every 8 connection(s)
I20260809 18:57:26.784605 7195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:26.789697 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.785399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:34169 (local address 127.23.229.62:38035)
0809 18:57:26.785470 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.785471 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.785738 (+ 267us) server_negotiation.cc:407] Connection header received
0809 18:57:26.786250 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.786251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.786263 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.786313 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.786971 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.787474 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.788415 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.788685 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.788739 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.789499 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:26.789501 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:26.789501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:26.789506 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:26.789521 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:26.789525 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:26.789567 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:26.789614 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 18:57:26.789638 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:57:26.789956 7409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.785388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38035 (local address 127.23.229.2:34169)
0809 18:57:26.785610 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.785652 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.786161 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.786375 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.786378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.786387 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.786893 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.786897 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.787553 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.787554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.788345 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.788347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.788757 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.788758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.788873 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.789374 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:26.789375 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.789401 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:26.789423 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:26.789567 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:26.789570 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:26.789572 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:57:26.789616 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 18:57:26.789690 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":101,"threads_started":1}
I20260809 18:57:26.790458 7404 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38035
I20260809 18:57:26.790549 7404 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:26.790702 7404 heartbeater.cc:511] Master 127.23.229.62:38035 requested a full tablet report, sending...
I20260809 18:57:26.791096 6866 ts_manager.cc:194] Registered new tserver with Master: 9b4fb0a1e1164db481eb38406f52b19f (127.23.229.2:46859)
I20260809 18:57:26.791476 6866 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.2:34169
I20260809 18:57:26.793385 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 7195
I20260809 18:57:26.793470 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:26.793684 24468 external_mini_cluster.cc:1428] Setting key aef4a110682fdf852eebdeae1a0b2c6a
I20260809 18:57:26.794579 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38035
--builtin_ntp_servers=127.23.229.20:38279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 18:57:26.878377 7410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:26.878646 7410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:26.878681 7410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:26.879850 7410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:26.879914 7410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:26.879953 7410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:57:26.881388 7410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:26.881672 7410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:26.881985 7410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:26.887357 7422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:26.887302 7427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:26.887326 7410 server_base.cc:1034] running on GCE node
W20260809 18:57:26.887308 7417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:26.887810 7410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:26.888070 7410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:26.889211 7410 hybrid_clock.cc:648] HybridClock initialized: now 1786301846889192 us; error 40 us; skew 500 ppm
I20260809 18:57:26.890532 7410 webserver.cc:460] Webserver started at http://127.23.229.3:44329/ using document root <none> and password file <none>
I20260809 18:57:26.890825 7410 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:26.890887 7410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:26.891059 7410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:26.892160 7410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "ebcf589b9fa54218b45cd2bd9448c0e2"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "004252fd376c4a55032aead3c5709509"
server_key_iv: "ce8062812f33839784bc9a9a3fe219af"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.892590 7410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "ebcf589b9fa54218b45cd2bd9448c0e2"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "004252fd376c4a55032aead3c5709509"
server_key_iv: "ce8062812f33839784bc9a9a3fe219af"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.893975 7410 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:26.894693 7443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.894865 7410 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:57:26.894968 7410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "ebcf589b9fa54218b45cd2bd9448c0e2"
format_stamp: "Formatted at 2026-08-09 18:57:26 on dist-test-slave-jq4t"
server_key: "004252fd376c4a55032aead3c5709509"
server_key_iv: "ce8062812f33839784bc9a9a3fe219af"
server_key_version: "encryptionkey@0"
I20260809 18:57:26.895048 7410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:26.914633 7410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:26.915028 7410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:26.915200 7410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:26.915470 7410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:26.915853 7410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:26.915906 7410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.915949 7410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:26.915992 7410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:26.922001 7410 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:33707
I20260809 18:57:26.922087 7615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:33707 every 8 connection(s)
I20260809 18:57:26.922465 7410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:26.927706 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.923300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:37493 (local address 127.23.229.62:38035)
0809 18:57:26.923371 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.923373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.923633 (+ 260us) server_negotiation.cc:407] Connection header received
0809 18:57:26.924175 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.924176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.924189 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.924256 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.924975 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.925483 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.926450 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.926637 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.926693 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.927472 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:26.927473 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:26.927473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:26.927477 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:26.927490 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:26.927494 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:26.927536 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:26.927619 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 18:57:26.927643 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:57:26.927935 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.923295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38035 (local address 127.23.229.3:37493)
0809 18:57:26.923496 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.923539 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.924044 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.924314 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.924317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.924326 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.924893 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.924898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.925563 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.925564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.926357 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.926359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.926711 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.926712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.926823 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.927329 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:26.927329 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.927357 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:26.927387 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:26.927547 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:26.927551 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:26.927554 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:26.927606 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 18:57:26.927686 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
I20260809 18:57:26.928491 7616 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38035
I20260809 18:57:26.928591 7616 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:26.928743 7616 heartbeater.cc:511] Master 127.23.229.62:38035 requested a full tablet report, sending...
I20260809 18:57:26.929121 6866 ts_manager.cc:194] Registered new tserver with Master: ebcf589b9fa54218b45cd2bd9448c0e2 (127.23.229.3:33707)
I20260809 18:57:26.929459 6866 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.3:37493
I20260809 18:57:26.930240 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 7410
I20260809 18:57:26.930351 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:26.930545 24468 external_mini_cluster.cc:1428] Setting key 2a6878d71d46607f2900c0f9ef5abf23
I20260809 18:57:26.931365 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:57:26.933346 6933 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:26.932782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47920 (local address 127.23.229.62:38035)
0809 18:57:26.932880 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.932882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.932974 (+ 92us) server_negotiation.cc:407] Connection header received
0809 18:57:26.933066 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.933067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.933081 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.933128 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.933278 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47920: BlockingRecv error: recv got EOF from 127.0.0.1:47920 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:57:26.933516 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 6973
I20260809 18:57:26.947999 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 7195
I20260809 18:57:26.957289 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 7410
I20260809 18:57:26.964691 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 6813
2026-08-09T18:57:26Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (644 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T18:57:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:26Z Disabled control of system clock
I20260809 18:57:26.997589 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41697
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:41697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:57:27.087431 7630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:27.087668 7630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:27.087694 7630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:27.088973 7630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:27.089027 7630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:27.089040 7630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:27.089053 7630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:27.089066 7630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:27.090555 7630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:41697
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:27.090873 7630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:27.091215 7630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:27.096521 7644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:27.096529 7641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:27.096663 7630 server_base.cc:1034] running on GCE node
W20260809 18:57:27.096597 7642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:27.097162 7630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:27.097527 7630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:27.098697 7630 hybrid_clock.cc:648] HybridClock initialized: now 1786301847098662 us; error 57 us; skew 500 ppm
I20260809 18:57:27.100265 7630 webserver.cc:460] Webserver started at http://127.23.229.62:44129/ using document root <none> and password file <none>
I20260809 18:57:27.100620 7630 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:27.100693 7630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:27.100835 7630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:27.102037 7630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "26c0c65c4afd4836af60db2500f26626"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "4d6b7da41ed00ace11bf76af2344b305"
server_key_iv: "8324149569dbaec4c20215f2f7d27ca1"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.102484 7630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "26c0c65c4afd4836af60db2500f26626"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "4d6b7da41ed00ace11bf76af2344b305"
server_key_iv: "8324149569dbaec4c20215f2f7d27ca1"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.103863 7630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:57:27.104656 7657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.104836 7630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:27.104939 7630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "26c0c65c4afd4836af60db2500f26626"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "4d6b7da41ed00ace11bf76af2344b305"
server_key_iv: "8324149569dbaec4c20215f2f7d27ca1"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.105026 7630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:27.109163 7630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:27.109465 7630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:27.109611 7630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:27.113989 7630 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:41697
I20260809 18:57:27.114037 7748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:41697 every 8 connection(s)
I20260809 18:57:27.114436 7630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:27.115197 7749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:27.118146 7749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626: Bootstrap starting.
I20260809 18:57:27.118705 7749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:27.118949 7749 log.cc:824] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:27.119663 7749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626: No bootstrap required, opened a new log
I20260809 18:57:27.121320 7749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c0c65c4afd4836af60db2500f26626" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41697 } }
I20260809 18:57:27.121457 7749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:27.121480 7749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c0c65c4afd4836af60db2500f26626, State: Initialized, Role: FOLLOWER
I20260809 18:57:27.121622 7749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c0c65c4afd4836af60db2500f26626" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41697 } }
I20260809 18:57:27.121714 7749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:27.121738 7749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:27.121775 7749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:27.122210 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 7630
I20260809 18:57:27.122272 7749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c0c65c4afd4836af60db2500f26626" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41697 } }
I20260809 18:57:27.122325 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:57:27.122399 7749 leader_election.cc:302] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26c0c65c4afd4836af60db2500f26626; no voters:
I20260809 18:57:27.122558 24468 external_mini_cluster.cc:1428] Setting key 6741578e34fa20e43b955c85096e992f
I20260809 18:57:27.122596 7749 leader_election.cc:288] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:27.122629 7755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:27.122799 7755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [term 1 LEADER]: Becoming Leader. State: Replica: 26c0c65c4afd4836af60db2500f26626, State: Running, Role: LEADER
I20260809 18:57:27.122938 7749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:27.123057 7755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c0c65c4afd4836af60db2500f26626" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41697 } }
I20260809 18:57:27.123400 7755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26c0c65c4afd4836af60db2500f26626. Latest consensus state: current_term: 1 leader_uuid: "26c0c65c4afd4836af60db2500f26626" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c0c65c4afd4836af60db2500f26626" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41697 } } }
I20260809 18:57:27.123472 7755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:27.123672 7756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26c0c65c4afd4836af60db2500f26626" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c0c65c4afd4836af60db2500f26626" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41697 } } }
I20260809 18:57:27.123824 7756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:27.124408 7765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:27.125160 7765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:27.125824 7763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.123273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42788 (local address 127.23.229.62:41697)
0809 18:57:27.123530 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.123540 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.123577 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:57:27.123711 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.123719 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.123767 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.123915 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.125149 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:27.125153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:27.125153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:27.125158 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:27.125207 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:27.125223 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:27.125309 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:27.125555 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 18:57:27.125627 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260809 18:57:27.126857 7765 catalog_manager.cc:1347] Generated new cluster ID: 4bc6037f71d04daa88b189c4a049ce26
I20260809 18:57:27.126919 7765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:27.160470 7765 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:27.160734 7765 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:27.164875 7765 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26c0c65c4afd4836af60db2500f26626: Generated new TSK 0
I20260809 18:57:27.165092 7765 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:57:27.166464 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41697
--builtin_ntp_servers=127.23.229.20:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:57:27.253891 7805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:27.254112 7805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:27.254135 7805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:27.255354 7805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:27.255398 7805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:27.255425 7805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:57:27.256845 7805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:27.257112 7805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:27.257421 7805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:27.263356 7815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:27.263356 7818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:27.263388 7814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:27.263640 7805 server_base.cc:1034] running on GCE node
I20260809 18:57:27.263849 7805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:27.264062 7805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:27.265200 7805 hybrid_clock.cc:648] HybridClock initialized: now 1786301847265183 us; error 34 us; skew 500 ppm
I20260809 18:57:27.266530 7805 webserver.cc:460] Webserver started at http://127.23.229.1:41339/ using document root <none> and password file <none>
I20260809 18:57:27.266780 7805 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:27.266849 7805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:27.267017 7805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:27.268134 7805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "1e04e24d445e4c89817ca67a1872c60a"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "043934c9d831c2480066003f5d6ffbe9"
server_key_iv: "8e60cc443e67092132119af7f8c43f49"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.268563 7805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "1e04e24d445e4c89817ca67a1872c60a"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "043934c9d831c2480066003f5d6ffbe9"
server_key_iv: "8e60cc443e67092132119af7f8c43f49"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.269934 7805 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:27.270697 7833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.270895 7805 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:57:27.271003 7805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "1e04e24d445e4c89817ca67a1872c60a"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "043934c9d831c2480066003f5d6ffbe9"
server_key_iv: "8e60cc443e67092132119af7f8c43f49"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.271097 7805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:27.274587 7805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:27.274880 7805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:27.275027 7805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:27.275249 7805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:27.275568 7805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:27.275620 7805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.275660 7805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:27.275688 7805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.281661 7805 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:46381
I20260809 18:57:27.281706 8021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:46381 every 8 connection(s)
I20260809 18:57:27.282058 7805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:27.282354 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 7805
I20260809 18:57:27.282457 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:27.282708 24468 external_mini_cluster.cc:1428] Setting key 2e131ee3f21be8622a4c2a157745d1c3
I20260809 18:57:27.283792 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41697
--builtin_ntp_servers=127.23.229.20:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 18:57:27.285980 7763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.282866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:41969 (local address 127.23.229.62:41697)
0809 18:57:27.282936 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.282938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.283216 (+ 278us) server_negotiation.cc:407] Connection header received
0809 18:57:27.283988 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.283989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.283997 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.284029 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.285653 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:27.285655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:27.285656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:27.285662 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:27.285686 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:27.285693 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:27.285766 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:27.285862 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 18:57:27.285882 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:57:27.286126 8029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.282864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41697 (local address 127.23.229.1:41969)
0809 18:57:27.283080 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:27.283128 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:27.283837 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:27.284227 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:27.284232 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:27.284243 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:27.285450 (+ 1207us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:27.285451 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:27.285494 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:27.285541 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:27.285771 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:27.285777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:27.285780 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:27.285856 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 18:57:27.285919 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260809 18:57:27.286643 8022 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41697
I20260809 18:57:27.286753 8022 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:27.286916 8022 heartbeater.cc:511] Master 127.23.229.62:41697 requested a full tablet report, sending...
I20260809 18:57:27.287482 7685 ts_manager.cc:194] Registered new tserver with Master: 1e04e24d445e4c89817ca67a1872c60a (127.23.229.1:46381)
W20260809 18:57:27.370875 8030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:27.371142 8030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:27.371181 8030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:27.372375 8030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:27.372440 8030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:27.372483 8030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:57:27.374055 8030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:27.374333 8030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:27.374647 8030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:27.380123 8035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:27.380184 8030 server_base.cc:1034] running on GCE node
W20260809 18:57:27.380270 8036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:27.380345 8039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:27.380616 8030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:27.380936 8030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:27.382062 8030 hybrid_clock.cc:648] HybridClock initialized: now 1786301847382026 us; error 54 us; skew 500 ppm
I20260809 18:57:27.383675 8030 webserver.cc:460] Webserver started at http://127.23.229.2:41421/ using document root <none> and password file <none>
I20260809 18:57:27.384012 8030 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:27.384083 8030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:27.384217 8030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:27.385695 8030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "131c1aa81c03481bb036d290b2706a82"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "ef32bf907a89c053268e4a10ddd58abd"
server_key_iv: "043e9c68992f0858c8a2ee189a4795c5"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.386170 8030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "131c1aa81c03481bb036d290b2706a82"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "ef32bf907a89c053268e4a10ddd58abd"
server_key_iv: "043e9c68992f0858c8a2ee189a4795c5"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.388116 8030 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:27.389937 8048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.390273 8030 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:27.390362 8030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "131c1aa81c03481bb036d290b2706a82"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "ef32bf907a89c053268e4a10ddd58abd"
server_key_iv: "043e9c68992f0858c8a2ee189a4795c5"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.390421 8030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:27.393918 8030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:27.394161 8030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:27.394260 8030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:27.394420 8030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:27.394690 8030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:27.394721 8030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.394743 8030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:27.394761 8030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.400717 8030 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:37053
I20260809 18:57:27.400758 8240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:37053 every 8 connection(s)
I20260809 18:57:27.401113 8030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:27.404363 7763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.401896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:56825 (local address 127.23.229.62:41697)
0809 18:57:27.401984 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.401986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.402223 (+ 237us) server_negotiation.cc:407] Connection header received
0809 18:57:27.402818 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.402819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.402825 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.402893 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.404105 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:27.404107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:27.404107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:27.404112 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:27.404130 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:27.404135 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:27.404200 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:27.404275 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 18:57:27.404289 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:57:27.404558 8244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.401896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41697 (local address 127.23.229.2:56825)
0809 18:57:27.402088 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:27.402131 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:27.402722 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:27.402989 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:27.402992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:27.403001 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:27.403917 (+ 916us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:27.403918 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:27.403963 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:27.403993 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:27.404204 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:27.404209 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:27.404212 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:27.404273 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 18:57:27.404327 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260809 18:57:27.405059 8241 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41697
I20260809 18:57:27.405160 8241 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:27.405340 8241 heartbeater.cc:511] Master 127.23.229.62:41697 requested a full tablet report, sending...
I20260809 18:57:27.405740 7685 ts_manager.cc:194] Registered new tserver with Master: 131c1aa81c03481bb036d290b2706a82 (127.23.229.2:37053)
I20260809 18:57:27.410627 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 8030
I20260809 18:57:27.410732 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:27.410928 24468 external_mini_cluster.cc:1428] Setting key c51895ba50a3ea790ca4603af7ffa097
I20260809 18:57:27.412001 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41697
--builtin_ntp_servers=127.23.229.20:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:57:27.499243 8245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:27.499472 8245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:27.499496 8245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:27.500698 8245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:27.500735 8245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:27.500813 8245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:57:27.502243 8245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:27.502485 8245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:27.502843 8245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:27.508203 8251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:27.508225 8256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:27.508209 8252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:27.508634 8245 server_base.cc:1034] running on GCE node
I20260809 18:57:27.508883 8245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:27.509161 8245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:27.510308 8245 hybrid_clock.cc:648] HybridClock initialized: now 1786301847510294 us; error 32 us; skew 500 ppm
I20260809 18:57:27.511848 8245 webserver.cc:460] Webserver started at http://127.23.229.3:35989/ using document root <none> and password file <none>
I20260809 18:57:27.512145 8245 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:27.512198 8245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:27.512329 8245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:27.513550 8245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "9613ff100e4b4068845ebb2ecfa0b6cb"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "b3c1684f5827af365230de71e3944f25"
server_key_iv: "808cdf7768fd7abf20d31fdf285ae700"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.513931 8245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "9613ff100e4b4068845ebb2ecfa0b6cb"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "b3c1684f5827af365230de71e3944f25"
server_key_iv: "808cdf7768fd7abf20d31fdf285ae700"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.515326 8245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:57:27.516240 8268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.516458 8245 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:27.516579 8245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "9613ff100e4b4068845ebb2ecfa0b6cb"
format_stamp: "Formatted at 2026-08-09 18:57:27 on dist-test-slave-jq4t"
server_key: "b3c1684f5827af365230de71e3944f25"
server_key_iv: "808cdf7768fd7abf20d31fdf285ae700"
server_key_version: "encryptionkey@0"
I20260809 18:57:27.516674 8245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:27.520747 8245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:27.521044 8245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:27.521188 8245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:27.521409 8245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:27.521742 8245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:27.521792 8245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.521834 8245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:27.521863 8245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:27.528111 8245 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:38057
I20260809 18:57:27.528141 8475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:38057 every 8 connection(s)
I20260809 18:57:27.528560 8245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:27.531972 7763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.529393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:57753 (local address 127.23.229.62:41697)
0809 18:57:27.529481 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.529484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.529707 (+ 223us) server_negotiation.cc:407] Connection header received
0809 18:57:27.530224 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.530226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.530233 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.530291 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.531715 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:27.531716 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:27.531717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:27.531722 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:27.531739 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:27.531744 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:27.531811 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:27.531897 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 18:57:27.531913 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:57:27.532150 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.529352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41697 (local address 127.23.229.3:57753)
0809 18:57:27.529578 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:27.529615 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:27.530123 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:27.530350 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:27.530354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:27.530363 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:27.531534 (+ 1171us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:27.531534 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:27.531565 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:27.531598 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:27.531809 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:27.531812 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:27.531815 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:27.531876 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 18:57:27.531929 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":120,"threads_started":1}
I20260809 18:57:27.532696 8476 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41697
I20260809 18:57:27.532800 8476 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:27.532933 8476 heartbeater.cc:511] Master 127.23.229.62:41697 requested a full tablet report, sending...
I20260809 18:57:27.533344 7685 ts_manager.cc:194] Registered new tserver with Master: 9613ff100e4b4068845ebb2ecfa0b6cb (127.23.229.3:38057)
I20260809 18:57:27.538451 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 8245
I20260809 18:57:27.538586 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:27.538791 24468 external_mini_cluster.cc:1428] Setting key 99eb4265720d851c781af45bc9be650f
I20260809 18:57:27.539999 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:57:27.542100 7763 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:27.541483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.23.229.62:41697)
0809 18:57:27.541573 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.541576 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.541726 (+ 150us) server_negotiation.cc:407] Connection header received
0809 18:57:27.541777 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.541778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.541783 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.541835 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.542015 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42804: BlockingRecv error: recv got EOF from 127.0.0.1:42804 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:57:27.542138 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 7805
I20260809 18:57:27.574496 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 8030
I20260809 18:57:27.587437 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 8245
I20260809 18:57:27.598770 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 7630
2026-08-09T18:57:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (638 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:27 dist-test-slave-jq4t krb5kdc[8490](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:27 dist-test-slave-jq4t krb5kdc[8490](info): set up 2 sockets
Aug 09 18:57:27 dist-test-slave-jq4t krb5kdc[8490](info): commencing operation
krb5kdc: starting...
W20260809 18:57:28.846060 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:57:28 dist-test-slave-jq4t krb5kdc[8490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:57:28.971642 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:36491
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:36491
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:29.056672 8512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:29.056931 8512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:29.056972 8512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:29.058109 8512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:29.058180 8512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:29.058205 8512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:29.058226 8512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:29.058254 8512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:29.059741 8512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:36491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:36491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:29.060029 8512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:29.060257 8512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:29.065232 8524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:29.065219 8525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:29.065295 8512 server_base.cc:1034] running on GCE node
W20260809 18:57:29.065238 8528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:29.065676 8512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:29.065972 8512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:29.067108 8512 hybrid_clock.cc:648] HybridClock initialized: now 1786301849067083 us; error 48 us; skew 500 ppm
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:29.069605 8512 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:57:29.070081 8512 webserver.cc:460] Webserver started at http://127.23.229.62:35137/ using document root <none> and password file <none>
I20260809 18:57:29.070333 8512 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:29.070401 8512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:29.070544 8512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:29.071642 8512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "0fd15e1f07414d61b9fa2ed2ea252990"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "f30b482491d477c998d806acf1b9889a"
server_key_iv: "b0bbbd359d3a2c34f52a486c16d3d9e9"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.072017 8512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "0fd15e1f07414d61b9fa2ed2ea252990"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "f30b482491d477c998d806acf1b9889a"
server_key_iv: "b0bbbd359d3a2c34f52a486c16d3d9e9"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.073462 8512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:57:29.074182 8537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.074348 8512 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:57:29.074448 8512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "0fd15e1f07414d61b9fa2ed2ea252990"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "f30b482491d477c998d806acf1b9889a"
server_key_iv: "b0bbbd359d3a2c34f52a486c16d3d9e9"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.074527 8512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:29.089175 8512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:29.091192 8512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:29.091374 8512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:29.095752 8512 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:36491
I20260809 18:57:29.095791 8622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:36491 every 8 connection(s)
I20260809 18:57:29.096199 8512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:29.096767 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 8512
I20260809 18:57:29.096870 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:57:29.097076 24468 external_mini_cluster.cc:1428] Setting key d921620ebbfe5de3b2f22c86db93a2b0
I20260809 18:57:29.097484 8627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:29.100827 8627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990: Bootstrap starting.
I20260809 18:57:29.101554 8627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:29.101866 8627 log.cc:824] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:29.102589 8627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990: No bootstrap required, opened a new log
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:29.104789 8627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36491 } }
I20260809 18:57:29.104962 8627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:29.105032 8627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fd15e1f07414d61b9fa2ed2ea252990, State: Initialized, Role: FOLLOWER
I20260809 18:57:29.105198 8627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36491 } }
I20260809 18:57:29.105310 8627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:29.105350 8627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:29.105394 8627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:29.106074 8627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36491 } }
I20260809 18:57:29.106199 8627 leader_election.cc:302] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fd15e1f07414d61b9fa2ed2ea252990; no voters:
I20260809 18:57:29.106386 8627 leader_election.cc:288] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:29.106439 8636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:29.106659 8636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [term 1 LEADER]: Becoming Leader. State: Replica: 0fd15e1f07414d61b9fa2ed2ea252990, State: Running, Role: LEADER
I20260809 18:57:29.106670 8627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:29.106770 8636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36491 } }
I20260809 18:57:29.107214 8637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36491 } } }
I20260809 18:57:29.107208 8639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fd15e1f07414d61b9fa2ed2ea252990. Latest consensus state: current_term: 1 leader_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd15e1f07414d61b9fa2ed2ea252990" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 36491 } } }
I20260809 18:57:29.107314 8637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:29.107321 8639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:29.107741 8651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:29.108264 8651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:29.111773 8631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.097678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32982 (local address 127.23.229.62:36491)
0809 18:57:29.097858 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.097873 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.097907 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:57:29.098634 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.098642 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.098694 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.098816 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.099625 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.100628 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.101661 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.102139 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.102263 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.105015 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:29.105020 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:29.105020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:29.105035 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:29.110099 (+ 5064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.110487 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.110491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.110491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.110604 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.110852 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.110854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.110854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.111185 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:29.111352 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.111490 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.111610 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260809 18:57:29.112190 8651 catalog_manager.cc:1347] Generated new cluster ID: be14fe8322ba472187c528aea0824398
I20260809 18:57:29.112248 8651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:29.120719 8651 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:29.121474 8651 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:29.127027 8651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990: Generated new TSK 0
I20260809 18:57:29.127259 8651 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:57:29.165510 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36491
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:29.261394 8669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:29.261734 8669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:29.261780 8669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:29.262998 8669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:29.263067 8669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:29.263111 8669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:57:29.264748 8669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:29.264953 8669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:29.265137 8669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:29.270339 8675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:29.270467 8681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:29.270354 8679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:29.270401 8669 server_base.cc:1034] running on GCE node
I20260809 18:57:29.270763 8669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:29.271039 8669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:29.272200 8669 hybrid_clock.cc:648] HybridClock initialized: now 1786301849272191 us; error 39 us; skew 500 ppm
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:29.274835 8669 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:57:29.275321 8669 webserver.cc:460] Webserver started at http://127.23.229.1:46153/ using document root <none> and password file <none>
I20260809 18:57:29.275523 8669 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:29.275564 8669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:29.275657 8669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:29.276800 8669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "38452fc920a040d2bbb04b2c68e7ac93"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "8ffb5381081f4f32e1fd5d9d41bdd1be"
server_key_iv: "c2b2d42d60b867f4c0aedbcb10cebef5"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.277125 8669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "38452fc920a040d2bbb04b2c68e7ac93"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "8ffb5381081f4f32e1fd5d9d41bdd1be"
server_key_iv: "c2b2d42d60b867f4c0aedbcb10cebef5"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.278635 8669 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:57:29.279313 8696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.279487 8669 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:57:29.279583 8669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "38452fc920a040d2bbb04b2c68e7ac93"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "8ffb5381081f4f32e1fd5d9d41bdd1be"
server_key_iv: "c2b2d42d60b867f4c0aedbcb10cebef5"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.279659 8669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:29.300036 8669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:29.302629 8669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:29.302788 8669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:29.303061 8669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:29.303406 8669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:29.303450 8669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.303499 8669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:29.303524 8669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.310144 8669 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:34749
I20260809 18:57:29.310189 8876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:34749 every 8 connection(s)
I20260809 18:57:29.310547 8669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:29.312512 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 8669
I20260809 18:57:29.312615 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:29.312824 24468 external_mini_cluster.cc:1428] Setting key a5d179ab22356518cbd777b76b97fb94
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:29.321714 8631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.311344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:47525 (local address 127.23.229.62:36491)
0809 18:57:29.311408 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.311410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.311613 (+ 203us) server_negotiation.cc:407] Connection header received
0809 18:57:29.312181 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.312183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.312194 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.312308 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.313451 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.314237 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.315421 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.315632 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.315691 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.318489 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:29.318490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:29.318491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:29.318499 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:29.320030 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.320607 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.320608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.320608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.320669 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.320982 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.320983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.320983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.321114 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:29.321166 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.321545 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.321644 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:57:29.322062 8880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.311312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:36491 (local address 127.23.229.1:47525)
0809 18:57:29.311478 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.311523 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.312062 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.312356 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.312359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.313152 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:29.313376 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.313382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.314342 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.314342 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.315326 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.315330 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.315721 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.315723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.315881 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.316508 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:29.316522 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:29.318375 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:29.320126 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:29.320136 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:29.320139 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:29.320534 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:29.320748 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:29.320748 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:29.320749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:29.320909 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:29.321181 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:29.321189 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:29.321380 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.321512 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.321709 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":84,"threads_started":1}
I20260809 18:57:29.322682 8877 heartbeater.cc:347] Connected to a master server at 127.23.229.62:36491
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 18:57:29.322789 8877 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:29.322997 8877 heartbeater.cc:511] Master 127.23.229.62:36491 requested a full tablet report, sending...
I20260809 18:57:29.323529 8567 ts_manager.cc:194] Registered new tserver with Master: 38452fc920a040d2bbb04b2c68e7ac93 (127.23.229.1:34749)
I20260809 18:57:29.324177 8567 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:47525
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:57:29.343138 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36491
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:29.431187 8887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:29.431447 8887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:29.431492 8887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:29.432700 8887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:29.432768 8887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:29.432811 8887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:57:29.434340 8887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:29.434638 8887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:29.434877 8887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:29.440171 8894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:29.440169 8900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:29.440178 8893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:29.440372 8887 server_base.cc:1034] running on GCE node
I20260809 18:57:29.440653 8887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:29.440899 8887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:29.442070 8887 hybrid_clock.cc:648] HybridClock initialized: now 1786301849442059 us; error 31 us; skew 500 ppm
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:29.444643 8887 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:57:29.445107 8887 webserver.cc:460] Webserver started at http://127.23.229.2:38997/ using document root <none> and password file <none>
I20260809 18:57:29.445369 8887 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:29.445436 8887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:29.445578 8887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:29.446657 8887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "208d3595e98c4a6790620aa7b87d4200"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "1bebdfa74c92ad7e20426027a4cdcbf0"
server_key_iv: "0dc61371e39bf30850e7ce2ad1937bba"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.447032 8887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "208d3595e98c4a6790620aa7b87d4200"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "1bebdfa74c92ad7e20426027a4cdcbf0"
server_key_iv: "0dc61371e39bf30850e7ce2ad1937bba"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.448374 8887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:57:29.449150 8910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.449321 8887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:57:29.449419 8887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "208d3595e98c4a6790620aa7b87d4200"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "1bebdfa74c92ad7e20426027a4cdcbf0"
server_key_iv: "0dc61371e39bf30850e7ce2ad1937bba"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.449501 8887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:29.471524 8887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:29.473532 8887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:29.473701 8887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:29.473958 8887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:29.474285 8887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:29.474339 8887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.474375 8887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:29.474417 8887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.480331 8887 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:42825
I20260809 18:57:29.480382 9099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:42825 every 8 connection(s)
I20260809 18:57:29.480732 8887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:29.489305 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 8887
I20260809 18:57:29.489410 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:29.489651 24468 external_mini_cluster.cc:1428] Setting key 31c1f58d66b887540a684a0d8ee7e1da
I20260809 18:57:29.490170 8631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.481414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:60325 (local address 127.23.229.62:36491)
0809 18:57:29.481468 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.481471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.481729 (+ 258us) server_negotiation.cc:407] Connection header received
0809 18:57:29.482218 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.482219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.482229 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.482298 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.483289 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.483882 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.484932 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.485129 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.485183 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.487404 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:29.487406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:29.487406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:29.487413 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:29.488705 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.489070 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.489070 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.489071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.489150 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.489403 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.489404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.489404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.489581 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:29.489651 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.489972 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.490086 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:57:29.490319 9102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.481423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:36491 (local address 127.23.229.2:60325)
0809 18:57:29.481606 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.481644 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.482135 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.482400 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.482404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.483004 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:29.483209 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.483214 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.483963 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.483964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.484865 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.484867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.485225 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.485227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.485364 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.485860 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:29.485869 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:29.487315 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:29.488776 (+ 1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:29.488783 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:29.488786 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:29.489008 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:29.489218 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:29.489219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:29.489219 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:29.489328 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:29.489661 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:29.489667 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:29.489829 (+ 162us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.489919 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.490108 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":98,"threads_started":1}
I20260809 18:57:29.490767 9100 heartbeater.cc:347] Connected to a master server at 127.23.229.62:36491
I20260809 18:57:29.490896 9100 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:29.491110 9100 heartbeater.cc:511] Master 127.23.229.62:36491 requested a full tablet report, sending...
I20260809 18:57:29.491514 8567 ts_manager.cc:194] Registered new tserver with Master: 208d3595e98c4a6790620aa7b87d4200 (127.23.229.2:42825)
I20260809 18:57:29.491905 8567 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:60325
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:57:29.518905 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36491
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:29.609372 9109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:29.609596 9109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:29.609622 9109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:29.610772 9109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:29.610831 9109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:29.610883 9109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:57:29.612670 9109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:36491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:57:29.612914 9109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:29.613162 9109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:29.618350 9119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:29.618412 9121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:29.618353 9116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:29.618657 9109 server_base.cc:1034] running on GCE node
I20260809 18:57:29.618942 9109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:29.619194 9109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:29.620373 9109 hybrid_clock.cc:648] HybridClock initialized: now 1786301849620348 us; error 35 us; skew 500 ppm
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:29.622941 9109 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:57:29.623364 9109 webserver.cc:460] Webserver started at http://127.23.229.3:42233/ using document root <none> and password file <none>
I20260809 18:57:29.623594 9109 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:29.623659 9109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:29.623808 9109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:29.624958 9109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "845f838571f14b4d88d39c644ebe1412"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "e87ea21b80a00b587b55622c8a9b7ae9"
server_key_iv: "a26e2335d8a52766fff3123d7ec3fda2"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.625329 9109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "845f838571f14b4d88d39c644ebe1412"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "e87ea21b80a00b587b55622c8a9b7ae9"
server_key_iv: "a26e2335d8a52766fff3123d7ec3fda2"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.626677 9109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:57:29.627480 9132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.627667 9109 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:29.627779 9109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "845f838571f14b4d88d39c644ebe1412"
format_stamp: "Formatted at 2026-08-09 18:57:29 on dist-test-slave-jq4t"
server_key: "e87ea21b80a00b587b55622c8a9b7ae9"
server_key_iv: "a26e2335d8a52766fff3123d7ec3fda2"
server_key_version: "encryptionkey@0"
I20260809 18:57:29.627858 9109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:29.639552 9109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:29.641927 9109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:29.642089 9109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:29.642313 9109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:29.642630 9109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:29.642683 9109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.642725 9109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:29.642761 9109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:29.648607 9109 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:40925
I20260809 18:57:29.648653 9309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:40925 every 8 connection(s)
I20260809 18:57:29.649013 9109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[8490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:57:29.655435 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 9109
I20260809 18:57:29.655548 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:29.655730 24468 external_mini_cluster.cc:1428] Setting key c2548831aa8a2172517f4806a0b150c3
I20260809 18:57:29.658833 8631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.649769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:39579 (local address 127.23.229.62:36491)
0809 18:57:29.649838 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.649841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.650070 (+ 229us) server_negotiation.cc:407] Connection header received
0809 18:57:29.650552 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.650553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.650564 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.650618 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.651578 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.652099 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.653223 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.653594 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.653660 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.655843 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:29.655846 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:29.655846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:29.655855 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:29.657423 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.657845 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.657847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.657847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.657906 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.658157 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.658158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.658158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.658284 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:29.658355 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.658654 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.658741 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:57:29.659039 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.649748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:36491 (local address 127.23.229.3:39579)
0809 18:57:29.649944 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.649987 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.650468 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.650675 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.650678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.651287 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:29.651515 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.651520 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.652241 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.652242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.653141 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.653144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.653679 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.653680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.653793 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.654291 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:29.654299 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:29.655739 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:29.657508 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:29.657523 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:29.657526 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:29.657755 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:29.657976 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:29.657977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:29.657977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:29.658092 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:29.658357 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:29.658365 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:29.658506 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.658619 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.658786 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":119,"threads_started":1}
I20260809 18:57:29.659487 9310 heartbeater.cc:347] Connected to a master server at 127.23.229.62:36491
I20260809 18:57:29.659602 9310 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:29.659785 9310 heartbeater.cc:511] Master 127.23.229.62:36491 requested a full tablet report, sending...
I20260809 18:57:29.660158 8567 ts_manager.cc:194] Registered new tserver with Master: 845f838571f14b4d88d39c644ebe1412 (127.23.229.3:40925)
I20260809 18:57:29.660620 8567 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:39579
I20260809 18:57:29.667814 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:57:29.675017 8631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.669212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32996 (local address 127.23.229.62:36491)
0809 18:57:29.669279 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.669280 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.669376 (+ 96us) server_negotiation.cc:407] Connection header received
0809 18:57:29.669422 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.669423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.669433 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.669487 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.670030 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.670529 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.671222 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.671421 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.671477 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.672669 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:29.672670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:29.672670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:29.672677 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:29.674104 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.674388 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.674389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.674389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.674443 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:29.674585 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:29.674585 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:29.674586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:29.674722 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:29.674795 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.674888 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.674953 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:57:29.676573 8567 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:29.678359 8567 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:29.685586 9328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.680783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50368 (local address 127.23.229.2:42825)
0809 18:57:29.681011 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.681016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.681232 (+ 216us) server_negotiation.cc:407] Connection header received
0809 18:57:29.681286 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.681289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.681308 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.681397 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:29.681581 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.682747 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.684556 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.685142 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.685222 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.685285 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.685451 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.685496 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":108,"threads_started":1}
I20260809 18:57:29.685765 9332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.680782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57652 (local address 127.23.229.1:34749)
0809 18:57:29.681096 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.681099 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.681225 (+ 126us) server_negotiation.cc:407] Connection header received
0809 18:57:29.681280 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.681283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.681301 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.681509 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:29.681712 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.682800 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.684454 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.685174 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.685262 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.685325 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.685622 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.685670 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":111,"threads_started":1}
I20260809 18:57:29.685581 9326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.680649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34749 (local address 127.0.0.1:57652)
0809 18:57:29.681144 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.681155 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.681213 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.681608 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.681608 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.681610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:29.681646 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.681647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.682904 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.682905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.684359 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.684362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.685359 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.685359 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.685426 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.685429 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.685475 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.685502 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":96,"thread_start_us":95,"threads_started":1}
I20260809 18:57:29.685581 9323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.680649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:42825 (local address 127.0.0.1:50368)
0809 18:57:29.681005 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.681054 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.681137 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.681405 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.681408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.681411 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:29.681487 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.681490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.682875 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.682877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.684359 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.684362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.685233 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.685235 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.685316 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.685330 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.685418 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.685486 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":78,"thread_start_us":55,"threads_started":1}
I20260809 18:57:29.686378 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.680845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:40925 (local address 127.0.0.1:58024)
0809 18:57:29.681168 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.681178 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.681239 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.681580 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.681581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.681584 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:29.681640 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.681641 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.683960 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.683961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.684890 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.684893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.685870 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.685871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.685942 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.685946 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.686278 (+ 332us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.686322 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":78,"threads_started":1}
I20260809 18:57:29.686698 9339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.680967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58024 (local address 127.23.229.3:40925)
0809 18:57:29.681154 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.681159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.681296 (+ 137us) server_negotiation.cc:407] Connection header received
0809 18:57:29.681407 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.681409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.681425 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.681499 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:29.682955 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.683859 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.684982 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.685718 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.685784 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.685833 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.686575 (+ 742us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.686621 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260809 18:57:29.686774 8990 tablet_service.cc:1467] Processing CreateTablet for tablet c1198f1a85f64302958681fe51e7f263 (DEFAULT_TABLE table=test-table [id=44f93eb656af49a5bd9504ed237838ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:29.686774 8772 tablet_service.cc:1467] Processing CreateTablet for tablet c1198f1a85f64302958681fe51e7f263 (DEFAULT_TABLE table=test-table [id=44f93eb656af49a5bd9504ed237838ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:29.687168 8772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1198f1a85f64302958681fe51e7f263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:29.687168 8990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1198f1a85f64302958681fe51e7f263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:29.687271 9210 tablet_service.cc:1467] Processing CreateTablet for tablet c1198f1a85f64302958681fe51e7f263 (DEFAULT_TABLE table=test-table [id=44f93eb656af49a5bd9504ed237838ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:29.687532 9210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1198f1a85f64302958681fe51e7f263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:29.690161 9340 tablet_bootstrap.cc:492] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Bootstrap starting.
I20260809 18:57:29.690584 9342 tablet_bootstrap.cc:492] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Bootstrap starting.
I20260809 18:57:29.691052 9340 tablet_bootstrap.cc:654] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:29.691264 9342 tablet_bootstrap.cc:654] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:29.691699 9340 log.cc:824] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:29.691908 9342 log.cc:824] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:29.692116 9345 tablet_bootstrap.cc:492] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93: Bootstrap starting.
I20260809 18:57:29.692618 9340 tablet_bootstrap.cc:492] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: No bootstrap required, opened a new log
I20260809 18:57:29.692696 9340 ts_tablet_manager.cc:1397] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:57:29.692816 9345 tablet_bootstrap.cc:654] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:29.692849 9342 tablet_bootstrap.cc:492] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: No bootstrap required, opened a new log
I20260809 18:57:29.692907 9342 ts_tablet_manager.cc:1397] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:29.693393 9345 log.cc:824] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:29.694245 9345 tablet_bootstrap.cc:492] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93: No bootstrap required, opened a new log
I20260809 18:57:29.694320 9345 ts_tablet_manager.cc:1397] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:29.694666 9340 raft_consensus.cc:348] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.694828 9340 raft_consensus.cc:374] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:29.694871 9340 raft_consensus.cc:729] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 845f838571f14b4d88d39c644ebe1412, State: Initialized, Role: FOLLOWER
I20260809 18:57:29.695019 9340 consensus_queue.cc:260] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.694993 9342 raft_consensus.cc:348] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.695156 9342 raft_consensus.cc:374] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:29.695195 9342 raft_consensus.cc:729] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208d3595e98c4a6790620aa7b87d4200, State: Initialized, Role: FOLLOWER
I20260809 18:57:29.695326 9340 ts_tablet_manager.cc:1428] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:57:29.695312 9342 consensus_queue.cc:260] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.695480 9310 heartbeater.cc:503] Master 127.23.229.62:36491 was elected leader, sending a full tablet report...
I20260809 18:57:29.695602 9342 ts_tablet_manager.cc:1428] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:29.695642 9100 heartbeater.cc:503] Master 127.23.229.62:36491 was elected leader, sending a full tablet report...
I20260809 18:57:29.696388 9345 raft_consensus.cc:348] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.696578 9345 raft_consensus.cc:374] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:29.696630 9345 raft_consensus.cc:729] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38452fc920a040d2bbb04b2c68e7ac93, State: Initialized, Role: FOLLOWER
I20260809 18:57:29.696749 9345 consensus_queue.cc:260] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.697057 9345 ts_tablet_manager.cc:1428] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:29.697074 8877 heartbeater.cc:503] Master 127.23.229.62:36491 was elected leader, sending a full tablet report...
W20260809 18:57:29.731309 9101 tablet.cc:2369] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:57:29.749846 9352 raft_consensus.cc:482] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:29.750002 9352 raft_consensus.cc:504] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.750391 9352 leader_election.cc:288] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38452fc920a040d2bbb04b2c68e7ac93 (127.23.229.1:34749), 845f838571f14b4d88d39c644ebe1412 (127.23.229.3:40925)
I20260809 18:57:29.754645 9339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.750691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:46845 (local address 127.23.229.3:40925)
0809 18:57:29.750739 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.750741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.750970 (+ 229us) server_negotiation.cc:407] Connection header received
0809 18:57:29.751006 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.751007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.751018 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.751070 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:29.751225 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.751971 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.753614 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.754243 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.754338 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.754360 (+ 22us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.754518 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.754565 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:57:29.754645 9332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.750721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:57951 (local address 127.23.229.1:34749)
0809 18:57:29.750774 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.750777 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.750788 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:57:29.750858 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.750860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.750872 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.750932 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:29.751148 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.751950 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.753614 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.754266 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.754338 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.754349 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.754518 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.754565 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:57:29.754659 9102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.750591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34749 (local address 127.23.229.2:57951)
0809 18:57:29.750660 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.750675 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.750743 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.750960 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.750961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.750963 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:29.751064 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.751066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.752048 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.752049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.753491 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.753495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.754348 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.754349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.754438 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.754440 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.754499 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.754553 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":67}
I20260809 18:57:29.754665 9357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.750591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:40925 (local address 127.23.229.2:46845)
0809 18:57:29.750879 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.750887 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.750958 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.751087 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.751088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.751090 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:29.751156 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.751157 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.752048 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.752049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.753491 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.753495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.754348 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.754349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.754435 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.754439 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:57:29.754499 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 18:57:29.754553 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":164,"thread_start_us":162,"threads_started":1}
I20260809 18:57:29.755298 9239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1198f1a85f64302958681fe51e7f263" candidate_uuid: "208d3595e98c4a6790620aa7b87d4200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "845f838571f14b4d88d39c644ebe1412" is_pre_election: true
I20260809 18:57:29.755308 8801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1198f1a85f64302958681fe51e7f263" candidate_uuid: "208d3595e98c4a6790620aa7b87d4200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38452fc920a040d2bbb04b2c68e7ac93" is_pre_election: true
I20260809 18:57:29.755496 9239 raft_consensus.cc:2454] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 208d3595e98c4a6790620aa7b87d4200 in term 0.
I20260809 18:57:29.755505 8801 raft_consensus.cc:2454] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 208d3595e98c4a6790620aa7b87d4200 in term 0.
I20260809 18:57:29.755751 8916 leader_election.cc:302] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208d3595e98c4a6790620aa7b87d4200, 845f838571f14b4d88d39c644ebe1412; no voters:
I20260809 18:57:29.755924 9352 raft_consensus.cc:2781] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:29.756021 9352 raft_consensus.cc:482] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:29.756052 9352 raft_consensus.cc:3037] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:29.756947 9352 raft_consensus.cc:504] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.757117 9352 leader_election.cc:288] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [CANDIDATE]: Term 1 election: Requested vote from peers 38452fc920a040d2bbb04b2c68e7ac93 (127.23.229.1:34749), 845f838571f14b4d88d39c644ebe1412 (127.23.229.3:40925)
I20260809 18:57:29.757277 8801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1198f1a85f64302958681fe51e7f263" candidate_uuid: "208d3595e98c4a6790620aa7b87d4200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38452fc920a040d2bbb04b2c68e7ac93"
I20260809 18:57:29.757368 8801 raft_consensus.cc:3037] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:29.758054 8801 raft_consensus.cc:2454] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 208d3595e98c4a6790620aa7b87d4200 in term 1.
I20260809 18:57:29.758201 9239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1198f1a85f64302958681fe51e7f263" candidate_uuid: "208d3595e98c4a6790620aa7b87d4200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "845f838571f14b4d88d39c644ebe1412"
I20260809 18:57:29.758241 8914 leader_election.cc:302] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208d3595e98c4a6790620aa7b87d4200, 38452fc920a040d2bbb04b2c68e7ac93; no voters:
I20260809 18:57:29.758311 9239 raft_consensus.cc:3037] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:29.758379 9352 raft_consensus.cc:2781] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:29.758575 9352 raft_consensus.cc:686] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 1 LEADER]: Becoming Leader. State: Replica: 208d3595e98c4a6790620aa7b87d4200, State: Running, Role: LEADER
I20260809 18:57:29.758693 9352 consensus_queue.cc:237] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } }
I20260809 18:57:29.759232 9239 raft_consensus.cc:2454] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 208d3595e98c4a6790620aa7b87d4200 in term 1.
I20260809 18:57:29.759594 8567 catalog_manager.cc:5495] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 208d3595e98c4a6790620aa7b87d4200 (127.23.229.2). New cstate: current_term: 1 leader_uuid: "208d3595e98c4a6790620aa7b87d4200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "208d3595e98c4a6790620aa7b87d4200" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:29.779295 9328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.776927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50372 (local address 127.23.229.2:42825)
0809 18:57:29.776984 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.776986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.777026 (+ 40us) server_negotiation.cc:407] Connection header received
0809 18:57:29.777062 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.777063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.777083 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.777138 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:29.777257 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.777782 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.778529 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.778760 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.778817 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.778938 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:29.779048 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:29.779109 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:29.779142 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 18:57:29.779160 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:57:29.781272 9239 raft_consensus.cc:1261] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 1 FOLLOWER]: Refusing update from remote peer 208d3595e98c4a6790620aa7b87d4200: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:29.781272 8801 raft_consensus.cc:1261] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 1 FOLLOWER]: Refusing update from remote peer 208d3595e98c4a6790620aa7b87d4200: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:29.781672 9358 consensus_queue.cc:1035] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845f838571f14b4d88d39c644ebe1412" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:29.781802 9352 consensus_queue.cc:1035] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38452fc920a040d2bbb04b2c68e7ac93" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:29.785979 9363 mvcc.cc:205] Tried to move back new op lower bound from 7316692376701014016 to 7316692376612278272. Current Snapshot: MvccSnapshot[applied={T|T < 7316692376701014016}]
I20260809 18:57:29.787143 8567 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:29.787242 8567 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:29.787992 8567 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fd15e1f07414d61b9fa2ed2ea252990: Sending DeleteTablet for 3 replicas of tablet c1198f1a85f64302958681fe51e7f263
I20260809 18:57:29.788335 8772 tablet_service.cc:1514] Processing DeleteTablet for tablet c1198f1a85f64302958681fe51e7f263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:29 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:57652
I20260809 18:57:29.788355 8990 tablet_service.cc:1514] Processing DeleteTablet for tablet c1198f1a85f64302958681fe51e7f263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:29 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:50368
I20260809 18:57:29.788609 9376 tablet_replica.cc:330] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93: stopping tablet replica
I20260809 18:57:29.788611 9210 tablet_service.cc:1514] Processing DeleteTablet for tablet c1198f1a85f64302958681fe51e7f263 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:29 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:58024
I20260809 18:57:29.788653 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 8669
I20260809 18:57:29.788723 9376 raft_consensus.cc:2229] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:29.788828 9376 raft_consensus.cc:2258] T c1198f1a85f64302958681fe51e7f263 P 38452fc920a040d2bbb04b2c68e7ac93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:29.788911 9378 tablet_replica.cc:330] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: stopping tablet replica
I20260809 18:57:29.788981 9377 tablet_replica.cc:330] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: stopping tablet replica
I20260809 18:57:29.789000 9378 raft_consensus.cc:2229] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:29.789060 9377 raft_consensus.cc:2229] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:29.789103 9378 raft_consensus.cc:2258] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:29.789146 9377 raft_consensus.cc:2258] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:29.789563 9378 ts_tablet_manager.cc:1905] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:29.791379 9378 ts_tablet_manager.cc:1918] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:29.791441 9378 log.cc:1196] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/c1198f1a85f64302958681fe51e7f263
I20260809 18:57:29.791676 9378 ts_tablet_manager.cc:1939] T c1198f1a85f64302958681fe51e7f263 P 845f838571f14b4d88d39c644ebe1412: Deleting consensus metadata
I20260809 18:57:29.792158 8545 catalog_manager.cc:4841] TS 845f838571f14b4d88d39c644ebe1412 (127.23.229.3:40925): tablet c1198f1a85f64302958681fe51e7f263 (table test-table [id=44f93eb656af49a5bd9504ed237838ac]) successfully deleted
I20260809 18:57:29.793619 9377 ts_tablet_manager.cc:1905] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:29.796274 9377 ts_tablet_manager.cc:1918] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:29.796352 9377 log.cc:1196] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/c1198f1a85f64302958681fe51e7f263
I20260809 18:57:29.796715 9377 ts_tablet_manager.cc:1939] T c1198f1a85f64302958681fe51e7f263 P 208d3595e98c4a6790620aa7b87d4200: Deleting consensus metadata
I20260809 18:57:29.797823 8545 catalog_manager.cc:4841] TS 208d3595e98c4a6790620aa7b87d4200 (127.23.229.2:42825): tablet c1198f1a85f64302958681fe51e7f263 (table test-table [id=44f93eb656af49a5bd9504ed237838ac]) successfully deleted
W20260809 18:57:29.806154 8540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:34749 (error 108)
I20260809 18:57:29.806394 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 8887
I20260809 18:57:29.812148 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.811993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34749 (local address 127.0.0.1:57662)
0809 18:57:29.812057 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.812102 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 18:57:29.812273 8540 catalog_manager.cc:4584] TS 38452fc920a040d2bbb04b2c68e7ac93 (127.23.229.1:34749): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c1198f1a85f64302958681fe51e7f263: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34749: connect: Connection refused (error 111)
I20260809 18:57:29.818831 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 9109
I20260809 18:57:29.831998 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 8512
2026-08-09T18:57:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2232 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[9384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[9384](info): set up 2 sockets
Aug 09 18:57:29 dist-test-slave-jq4t krb5kdc[9384](info): commencing operation
krb5kdc: starting...
W20260809 18:57:31.077178 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:57:31 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/rangeradmin_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/rangeradmin_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/rangerlookup_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/rangerlookup_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
I20260809 18:57:31.248379 24468 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskI_GCfH/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/postgres -l logfile start
2026-08-09 18:57:33.755 UTC [9432] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 18:57:33.755 UTC [9432] LOG: listening on IPv4 address "127.23.229.20", port 37095
2026-08-09 18:57:33.759 UTC [9432] LOG: listening on Unix socket "/tmp/.s.PGSQL.37095"
2026-08-09 18:57:33.795 UTC [9439] LOG: database system was shut down at 2026-08-09 18:57:32 UTC
2026-08-09 18:57:33.800 UTC [9432] LOG: database system is ready to accept connections
I20260809 18:57:34.951582 24468 mini_postgres.cc:96] Postgres bound to 37095
2026-08-09 18:57:34.958 UTC [9448] FATAL: database "slave" does not exist
127.23.229.20:37095 - accepting connections
I20260809 18:57:34.959549 24468 mini_ranger.cc:161] Starting Ranger...
I20260809 18:57:34.975733 24468 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 18:57:35.449983 24468 mini_ranger.cc:87] Created ranger Postgres database
I20260809 18:57:35.450078 24468 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-admin
2026-08-09 18:57:35,739 [I] DB FLAVOR :POSTGRES
2026-08-09 18:57:35,739 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:57:35,740 [I] Checking connection..
2026-08-09 18:57:35,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 18:57:35,987 [I] Checking connection passed.
2026-08-09 18:57:35,988 [I] --------- Verifying version history table ---------
2026-08-09 18:57:35,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:57:36,243 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:57:36,244 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:57:36,494 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:57:36,495 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 18:57:36,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 18:57:36.771 UTC [9550] WARNING: there is no transaction in progress
2026-08-09 18:57:36,780 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 18:57:36,780 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:57:37,041 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 18:57:37,041 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:57:37,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 18:57:37,295 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 18:57:37,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-09 18:57:37,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:57:38,050 [I] Table x_portal_user does not exist in database ranger
2026-08-09 18:57:38,050 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:57:38,321 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 18:57:38,321 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:57:38,576 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:57:38,845 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 18:57:38,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 18:57:39.847 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:39.864 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:39.882 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:39.899 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:39.919 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:39.941 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.000 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.008 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.022 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.034 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.044 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.059 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.069 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.076 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.082 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40.089 UTC [9727] WARNING: there is no transaction in progress
2026-08-09 18:57:40,731 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 18:57:40,732 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 18:57:40,994 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 18:57:40,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:57:41,262 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 18:57:41,263 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:57:41,512 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 18:57:41,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:57:41,771 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:57:42,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-09 18:57:42,291 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 18:57:42,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 18:57:42,562 [I] DB_PATCHES have already been applied
I20260809 18:57:42.568429 24468 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-admin:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskI_GCfH/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 18:57:42.568573 24468 mini_ranger.cc:193] Using host: 127.23.229.20
I20260809 18:57:42.572695 24468 mini_ranger.cc:227] Ranger admin URL: http://127.23.229.20:51459
Aug 09, 2026 6:57:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:57:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:57:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:57:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:57:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:57:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:57:43 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 18:57:43.944032 24468 mini_ranger.cc:160] Time spent starting Ranger: real 8.984s user 0.001s sys 0.010s
Aug 09, 2026 6:58:03 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:58:03 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 6:58:03 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:58:03 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:58:04 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 18:58:05.518277 24468 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/rangerkms_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/rangerkms_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.229.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.229.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 18:58:05 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301885, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 18:58:05.609815 24468 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 18:58:05.621253 24468 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 18:58:06.595208 24468 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 18:58:06.595309 24468 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms
I20260809 18:58:06.595332 24468 mini_ranger_kms.cc:227] Using postgres at 127.23.229.20:37095
2026-08-09 18:58:06,860 [I] DB FLAVOR :POSTGRES
2026-08-09 18:58:06,860 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:58:06,860 [I] Checking connection
2026-08-09 18:58:06,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 18:58:07,144 [I] connection success
2026-08-09 18:58:07,144 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 18:58:07,144 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 18:58:07,144 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 18:58:07,403 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 18:58:07,403 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:58:07,404 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 18:58:07,404 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:37095/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 18:58:07,674 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 18:58:08.209461 24468 mini_ranger_kms.cc:310] Created kms service
I20260809 18:58:08.449674 24468 mini_ranger_kms.cc:326] Created kudu user
I20260809 18:58:08.499712 24468 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 18:58:08 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301885, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:58:08.906445 24468 mini_ranger_kms.cc:384] Added ranger policy
I20260809 18:58:08.906576 24468 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms:/tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 18:58:08.906607 24468 mini_ranger_kms.cc:240] Using host: 127.23.229.20
I20260809 18:58:08.910861 24468 mini_ranger_kms.cc:276] Ranger KMS PID: 10001
I20260809 18:58:08.911021 24468 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.229.20:49689
Aug 09, 2026 6:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:58:10 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 18:58:11 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301891, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.229.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:11.747296 24468 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.137s user 0.004s sys 0.219s
I20260809 18:58:11.747422 24468 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 18:58:11.747510 24468 mini_ranger_kms.cc:401] 127.23.229.20:49689/kms/v1/keys
Aug 09 18:58:11 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301891, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.229.20@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
Aug 09 18:58:12 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301891, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.229.20@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
Aug 09 18:58:14 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:58:14.576934 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:45421
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:45421
--ranger_config_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:49689/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:58:14.665400 10081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:14.665618 10081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:14.665640 10081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:14.666798 10081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:58:14.666850 10081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:14.666864 10081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:14.666877 10081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:58:14.666889 10081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:58:14.668552 10081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.229.20:49689/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:45421
--ranger_config_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:45421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:58:14.668813 10081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:14.669090 10081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:14.674444 10093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:14.674580 10090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:14.674444 10091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:14.674852 10081 server_base.cc:1034] running on GCE node
I20260809 18:58:14.675119 10081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:14.675454 10081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:14.676606 10081 hybrid_clock.cc:648] HybridClock initialized: now 1786301894676580 us; error 44 us; skew 500 ppm
Aug 09 18:58:14 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301894, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:14.683043 10081 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:58:14.683630 10081 webserver.cc:460] Webserver started at http://127.23.229.62:41803/ using document root <none> and password file <none>
I20260809 18:58:14.683881 10081 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:14.683946 10081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:14.684103 10081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:14 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301894, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:58:14.734333 10081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "8d39bb17d9774b60923ecff1fe8e0da3"
format_stamp: "Formatted at 2026-08-09 18:58:14 on dist-test-slave-jq4t"
server_key: "bae61e8c8f85b8269c55e3f512449a7d"
server_key_iv: "f092eee9b1bc25c8b01eeb58a71db22e"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:14.734838 10081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "8d39bb17d9774b60923ecff1fe8e0da3"
format_stamp: "Formatted at 2026-08-09 18:58:14 on dist-test-slave-jq4t"
server_key: "bae61e8c8f85b8269c55e3f512449a7d"
server_key_iv: "f092eee9b1bc25c8b01eeb58a71db22e"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:14.736855 10081 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 18:58:14.751991 10100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:14.752290 10081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:58:14.752417 10081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "8d39bb17d9774b60923ecff1fe8e0da3"
format_stamp: "Formatted at 2026-08-09 18:58:14 on dist-test-slave-jq4t"
server_key: "bae61e8c8f85b8269c55e3f512449a7d"
server_key_iv: "f092eee9b1bc25c8b01eeb58a71db22e"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:14.752545 10081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:14.777215 10081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:14.779520 10081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:14.779693 10081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:14.784545 10081 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:45421
I20260809 18:58:14.784559 10182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:45421 every 8 connection(s)
I20260809 18:58:14.784989 10081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:58:14.785826 10183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:14.788938 10183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3: Bootstrap starting.
I20260809 18:58:14.789685 10183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:14.790014 10183 log.cc:824] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:14.790957 10183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3: No bootstrap required, opened a new log
I20260809 18:58:14.793826 10183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 45421 } }
I20260809 18:58:14.794040 10183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:14.794075 10183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d39bb17d9774b60923ecff1fe8e0da3, State: Initialized, Role: FOLLOWER
I20260809 18:58:14.794224 10183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 45421 } }
I20260809 18:58:14.794317 10183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:58:14.794346 10183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:58:14.794428 10183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:14.794541 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 10081
I20260809 18:58:14.794659 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:58:14.794849 24468 external_mini_cluster.cc:1428] Setting key 90cc34a6a5af920cb67fc9df386eb057
I20260809 18:58:14.795147 10183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 45421 } }
I20260809 18:58:14.795295 10183 leader_election.cc:302] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d39bb17d9774b60923ecff1fe8e0da3; no voters:
I20260809 18:58:14.795491 10183 leader_election.cc:288] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:58:14.795831 10193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:58:14.795846 10183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:58:14.795996 10193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [term 1 LEADER]: Becoming Leader. State: Replica: 8d39bb17d9774b60923ecff1fe8e0da3, State: Running, Role: LEADER
I20260809 18:58:14.797008 10193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 45421 } }
I20260809 18:58:14.797792 10183 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 18:58:14.800712 10190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 45421 } } }
I20260809 18:58:14.800974 10190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [sys.catalog]: This master's current role is: LEADER
I20260809 18:58:14.801674 10194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d39bb17d9774b60923ecff1fe8e0da3. Latest consensus state: current_term: 1 leader_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39bb17d9774b60923ecff1fe8e0da3" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 45421 } } }
I20260809 18:58:14.801806 10194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3 [sys.catalog]: This master's current role is: LEADER
I20260809 18:58:14.802486 10216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:58:14.804463 10216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:58:14 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:58:14.809373 10191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:14.795398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37348 (local address 127.23.229.62:45421)
0809 18:58:14.795582 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:14.795594 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:14.795692 (+ 98us) server_negotiation.cc:407] Connection header received
0809 18:58:14.795862 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:14.795869 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:14.795935 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:14.796092 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:14.796870 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:14.798412 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:14.800178 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:14.801841 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:14.801974 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:14.805191 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:14.805195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:14.805196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:14.805210 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:14.807485 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:14.807891 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:14.807895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:14.807896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:14.808028 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:14.808245 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:14.808246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:14.808246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:14.808667 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:14.808833 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:14.808933 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:58:14.809080 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260809 18:58:14.813889 10216 catalog_manager.cc:1347] Generated new cluster ID: ffa066d2ee7d499490f30b2f9bbb17bd
I20260809 18:58:14.813957 10216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:58:14.827085 10216 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:58:14.827968 10216 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:58:14.846822 10216 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3: Generated new TSK 0
I20260809 18:58:14.847137 10216 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:58:15.619640 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:49689/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:45421
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:58:15.749212 10249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:15.749552 10249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:15.749593 10249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:15.751648 10249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:15.751727 10249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:15.751775 10249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:58:15.754336 10249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.229.20:49689/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:45421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:58:15.754830 10249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:15.755192 10249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:15.761394 10258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:15.761395 10255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:15.761655 10256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:15.762583 10249 server_base.cc:1034] running on GCE node
I20260809 18:58:15.762814 10249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:15.763101 10249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:15.764274 10249 hybrid_clock.cc:648] HybridClock initialized: now 1786301895764250 us; error 43 us; skew 500 ppm
Aug 09 18:58:15 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301895, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:15.767457 10249 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:58:15.768100 10249 webserver.cc:460] Webserver started at http://127.23.229.1:35453/ using document root <none> and password file <none>
I20260809 18:58:15.768438 10249 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:15.768548 10249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:15.768704 10249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:15 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301895, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:58:15.783277 10249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "58e4c47b5641494fb71d1082900892f8"
format_stamp: "Formatted at 2026-08-09 18:58:15 on dist-test-slave-jq4t"
server_key: "f8b787f0a1d7501a42e9808c1812a998"
server_key_iv: "3eefaa5e869ccaaf710230f8e7123b11"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:15.783828 10249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "58e4c47b5641494fb71d1082900892f8"
format_stamp: "Formatted at 2026-08-09 18:58:15 on dist-test-slave-jq4t"
server_key: "f8b787f0a1d7501a42e9808c1812a998"
server_key_iv: "3eefaa5e869ccaaf710230f8e7123b11"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:15.788903 10249 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260809 18:58:15.804236 10265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:15.804558 10249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:58:15.804690 10249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "58e4c47b5641494fb71d1082900892f8"
format_stamp: "Formatted at 2026-08-09 18:58:15 on dist-test-slave-jq4t"
server_key: "f8b787f0a1d7501a42e9808c1812a998"
server_key_iv: "3eefaa5e869ccaaf710230f8e7123b11"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:15.804808 10249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:15.818338 10249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:15.821075 10249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:15.821300 10249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:15.821621 10249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:58:15.822080 10249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:58:15.822160 10249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:15.822217 10249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:58:15.822256 10249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:15.830075 10249 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:37581
I20260809 18:58:15.830685 10249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:58:15.832046 10435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:37581 every 8 connection(s)
I20260809 18:58:15.837544 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 10249
I20260809 18:58:15.837664 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:58:15.837872 24468 external_mini_cluster.cc:1428] Setting key d29dadda8bfd7a3068c3aaa6323883b2
Aug 09 18:58:15 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301895, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:58:15.846899 10442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:15.831663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:45421 (local address 127.23.229.1:41117)
0809 18:58:15.832326 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:15.832363 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:15.833177 (+ 814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:15.833608 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:15.833613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:15.833837 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:58:15.834068 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:15.834072 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:15.834952 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:15.834953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:15.836232 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:15.836236 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:15.836892 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:15.836893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:15.837076 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:15.838371 (+ 1295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:58:15.838383 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:58:15.840243 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:58:15.844932 (+ 4689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:15.844945 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:15.844948 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:15.845322 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:15.845572 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:15.845573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:15.845573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:15.845730 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:15.846107 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:58:15.846116 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:58:15.846311 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 18:58:15.846434 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 18:58:15.846622 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":104,"threads_started":1}
I20260809 18:58:15.847620 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:15.832038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:41117 (local address 127.23.229.62:45421)
0809 18:58:15.833356 (+ 1318us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:15.833358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:15.833366 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:58:15.833391 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:15.833392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:15.833404 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:15.833513 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:15.834193 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:15.834837 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:15.836355 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:15.836733 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:15.836812 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:15.840379 (+ 3567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:15.840381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:15.840381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:15.840391 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:15.844806 (+ 4415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:15.845421 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:15.845422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:15.845423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:15.845496 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:15.845812 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:15.845813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:15.845814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:15.846005 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:15.846076 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:15.847226 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0809 18:58:15.847438 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1283,"thread_start_us":90,"threads_started":1}
I20260809 18:58:15.848317 10436 heartbeater.cc:347] Connected to a master server at 127.23.229.62:45421
I20260809 18:58:15.848549 10436 heartbeater.cc:464] Registering TS with master...
I20260809 18:58:15.848820 10436 heartbeater.cc:511] Master 127.23.229.62:45421 requested a full tablet report, sending...
I20260809 18:58:15.849440 10123 ts_manager.cc:194] Registered new tserver with Master: 58e4c47b5641494fb71d1082900892f8 (127.23.229.1:37581)
I20260809 18:58:15.850149 10123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:41117
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:58:15.887207 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:49689/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:45421
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 18:58:16.064297 10447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:16.064728 10447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:16.064815 10447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:16.066687 10447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:16.066804 10447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:16.066895 10447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:58:16.069356 10447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.229.20:49689/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:45421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:58:16.069828 10447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:16.070168 10447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:16.080128 10458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:16.080094 10459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:16.080569 10464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:16.081774 10447 server_base.cc:1034] running on GCE node
I20260809 18:58:16.082140 10447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:16.082523 10447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:16.083707 10447 hybrid_clock.cc:648] HybridClock initialized: now 1786301896083685 us; error 48 us; skew 500 ppm
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:16.087409 10447 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:58:16.087900 10447 webserver.cc:460] Webserver started at http://127.23.229.2:45371/ using document root <none> and password file <none>
I20260809 18:58:16.088167 10447 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:16.088245 10447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:16.088459 10447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:58:16.114455 10447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "0fe0834ccb334cf389be29a2b9d8e918"
format_stamp: "Formatted at 2026-08-09 18:58:16 on dist-test-slave-jq4t"
server_key: "b86224b38c5af7cd6e29c5a859195692"
server_key_iv: "9db2b454ea3918395726e2d45db7ac96"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:16.115120 10447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "0fe0834ccb334cf389be29a2b9d8e918"
format_stamp: "Formatted at 2026-08-09 18:58:16 on dist-test-slave-jq4t"
server_key: "b86224b38c5af7cd6e29c5a859195692"
server_key_iv: "9db2b454ea3918395726e2d45db7ac96"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:16.120595 10447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.002s
I20260809 18:58:16.140151 10476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:16.140429 10447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:58:16.140573 10447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "0fe0834ccb334cf389be29a2b9d8e918"
format_stamp: "Formatted at 2026-08-09 18:58:16 on dist-test-slave-jq4t"
server_key: "b86224b38c5af7cd6e29c5a859195692"
server_key_iv: "9db2b454ea3918395726e2d45db7ac96"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:16.140688 10447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:16.154470 10447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:16.157248 10447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:16.157475 10447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:16.157881 10447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:58:16.158376 10447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:58:16.158468 10447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:16.158545 10447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:58:16.158603 10447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:16.179289 10447 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:45441
I20260809 18:58:16.179971 10447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:58:16.180441 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 10447
I20260809 18:58:16.180596 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:58:16.180871 24468 external_mini_cluster.cc:1428] Setting key 92480e99a670dde74403ef8273337cb8
I20260809 18:58:16.181952 10648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:45441 every 8 connection(s)
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:58:16.213495 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.184645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:32785 (local address 127.23.229.62:45421)
0809 18:58:16.184699 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.184701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.188984 (+ 4283us) server_negotiation.cc:407] Connection header received
0809 18:58:16.190201 (+ 1217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.190203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.190219 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.190264 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:16.201283 (+ 11019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.202203 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.204334 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.204858 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.204931 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.208965 (+ 4034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:16.208968 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:16.208968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:16.208978 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:16.211325 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:16.212075 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:16.212077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:16.212077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:16.212157 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:16.212519 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:16.212520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:16.212521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:16.212679 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:16.212733 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.213232 (+ 499us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.213344 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:58:16.214507 10652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.182805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:45421 (local address 127.23.229.2:32785)
0809 18:58:16.188703 (+ 5898us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:16.188817 (+ 114us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:16.190041 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:16.190565 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:16.190570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:16.191220 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:58:16.191703 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.191710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.202429 (+ 10719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.202430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.204200 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.204206 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.205087 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.205088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.205418 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.206252 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:58:16.206264 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:58:16.208812 (+ 2548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:58:16.211564 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:16.211572 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:16.211575 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:16.211957 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:16.212239 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:16.212240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:16.212240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:16.212409 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:16.212767 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:58:16.212773 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:58:16.212995 (+ 222us) client_negotiation.cc:769] Sending connection context
0809 18:58:16.213913 (+ 918us) client_negotiation.cc:240] Negotiation successful
0809 18:58:16.214182 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5793,"thread_start_us":184,"threads_started":1}
I20260809 18:58:16.215458 10650 heartbeater.cc:347] Connected to a master server at 127.23.229.62:45421
I20260809 18:58:16.215590 10650 heartbeater.cc:464] Registering TS with master...
I20260809 18:58:16.215816 10650 heartbeater.cc:511] Master 127.23.229.62:45421 requested a full tablet report, sending...
I20260809 18:58:16.216344 10123 ts_manager.cc:194] Registered new tserver with Master: 0fe0834ccb334cf389be29a2b9d8e918 (127.23.229.2:45441)
I20260809 18:58:16.216921 10123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:32785
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:58:16.223958 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:49689/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:45421
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:43623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:58:16.389418 10656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:16.389748 10656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:16.389796 10656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:16.391641 10656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:16.391716 10656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:16.391762 10656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:58:16.394080 10656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:43623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.229.20:49689/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:45421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:58:16.394570 10656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:16.394902 10656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:16.402247 10664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:16.402714 10667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:16.403136 10663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:16.404052 10656 server_base.cc:1034] running on GCE node
I20260809 18:58:16.404302 10656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:16.404734 10656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:16.405936 10656 hybrid_clock.cc:648] HybridClock initialized: now 1786301896405898 us; error 52 us; skew 500 ppm
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:16.409716 10656 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:58:16.410372 10656 webserver.cc:460] Webserver started at http://127.23.229.3:37127/ using document root <none> and password file <none>
I20260809 18:58:16.410681 10656 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:16.410759 10656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:16.410967 10656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:58:16.426390 10656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "4c9845aabac940bb81980364db7485b9"
format_stamp: "Formatted at 2026-08-09 18:58:16 on dist-test-slave-jq4t"
server_key: "7bc8ca408ccbea7d0e717f04698a180d"
server_key_iv: "83814cc13098cd337a20752da8ec69ef"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:16.427374 10656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "4c9845aabac940bb81980364db7485b9"
format_stamp: "Formatted at 2026-08-09 18:58:16 on dist-test-slave-jq4t"
server_key: "7bc8ca408ccbea7d0e717f04698a180d"
server_key_iv: "83814cc13098cd337a20752da8ec69ef"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:16.429705 10656 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 18:58:16.444597 10678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:16.444831 10656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:58:16.444947 10656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "4c9845aabac940bb81980364db7485b9"
format_stamp: "Formatted at 2026-08-09 18:58:16 on dist-test-slave-jq4t"
server_key: "7bc8ca408ccbea7d0e717f04698a180d"
server_key_iv: "83814cc13098cd337a20752da8ec69ef"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:16.445079 10656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:16.460247 10656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:16.462597 10656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:16.462780 10656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:16.463083 10656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:58:16.463495 10656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:58:16.463554 10656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:16.463596 10656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:58:16.463619 10656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:16.475597 10656 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:35705
I20260809 18:58:16.476048 10656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:58:16.484016 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 10656
I20260809 18:58:16.484154 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:58:16.484385 24468 external_mini_cluster.cc:1428] Setting key 51e2e06aa6e1c057245b552e43a03227
I20260809 18:58:16.485034 10861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:35705 every 8 connection(s)
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:58:16.496542 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.484520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:36453 (local address 127.23.229.62:45421)
0809 18:58:16.484582 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.484584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.485525 (+ 941us) server_negotiation.cc:407] Connection header received
0809 18:58:16.486233 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.486234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.486247 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.486294 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:16.487099 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.487889 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.489529 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.489858 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.489906 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.492888 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:16.492890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:16.492890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:16.492899 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:16.494756 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:16.495205 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:16.495206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:16.495207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:16.495274 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:16.495576 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:16.495577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:16.495577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:16.495745 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:16.495813 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.496296 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.496396 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 18:58:16.497087 10868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.484515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:45421 (local address 127.23.229.3:36453)
0809 18:58:16.485385 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:16.485433 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:16.486110 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:16.486379 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:16.486383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:16.486646 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:58:16.486961 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.486969 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.488038 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.488039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.489416 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.489419 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.490010 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.490011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.490175 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.490884 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:58:16.490895 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:58:16.492754 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:58:16.494844 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:16.494850 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:16.494853 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:16.495092 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:16.495360 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:16.495361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:16.495361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:16.495483 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:16.495924 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:58:16.495932 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:58:16.496127 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 18:58:16.496696 (+ 569us) client_negotiation.cc:240] Negotiation successful
0809 18:58:16.496889 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":259,"threads_started":1}
I20260809 18:58:16.497614 10864 heartbeater.cc:347] Connected to a master server at 127.23.229.62:45421
I20260809 18:58:16.497749 10864 heartbeater.cc:464] Registering TS with master...
I20260809 18:58:16.497982 10864 heartbeater.cc:511] Master 127.23.229.62:45421 requested a full tablet report, sending...
I20260809 18:58:16.498396 10123 ts_manager.cc:194] Registered new tserver with Master: 4c9845aabac940bb81980364db7485b9 (127.23.229.3:35705)
I20260809 18:58:16.498799 10123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:36453
I20260809 18:58:16.507421 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:58:16.516785 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.509473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36996 (local address 127.23.229.62:45421)
0809 18:58:16.509522 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.509524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.509683 (+ 159us) server_negotiation.cc:407] Connection header received
0809 18:58:16.509752 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.509753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.509765 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.509819 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:16.510667 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.511209 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.512011 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.512249 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.512330 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.513883 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:16.513885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:16.513885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:16.513894 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:16.515394 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:16.515809 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:16.515810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:16.515811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:16.515884 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:16.516107 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:16.516108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:16.516109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:16.516297 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:16.516425 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.516586 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.516669 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:58:16.518666 10123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:58:16.520403 10123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:58:16.530325 10884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.523229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:37581 (local address 127.0.0.1:55290)
0809 18:58:16.524178 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:16.524298 (+ 120us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:16.524371 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:16.524734 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:16.524737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:16.524739 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:16.524830 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.524832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.527356 (+ 2524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.527357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.528718 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.528721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.530039 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.530040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.530099 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.530103 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:58:16.530165 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:58:16.530229 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":23,"thread_start_us":199,"threads_started":1}
I20260809 18:58:16.530946 10891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.524047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.23.229.2:45441)
0809 18:58:16.525112 (+ 1065us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.525117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.525128 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:58:16.525164 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.525166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.525182 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.525257 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:16.525468 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.526494 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.527977 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.528771 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.528832 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.528914 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.530392 (+ 1478us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.530858 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1025,"thread_start_us":217,"threads_started":1}
I20260809 18:58:16.531267 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.523898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:45441 (local address 127.0.0.1:44018)
0809 18:58:16.524941 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:16.524951 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:16.524991 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:16.525332 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:16.525333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:16.525350 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:16.525389 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.525391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.526588 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.526588 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.527862 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.527865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.528944 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.528945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.529017 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.529033 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 18:58:16.530257 (+ 1224us) client_negotiation.cc:240] Negotiation successful
0809 18:58:16.530290 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1027,"thread_start_us":157,"threads_started":1}
I20260809 18:58:16.532101 10888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.523582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.23.229.1:37581)
0809 18:58:16.524084 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.524088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.524532 (+ 444us) server_negotiation.cc:407] Connection header received
0809 18:58:16.524569 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.524571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.524589 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.524658 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:16.526223 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.527258 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.529111 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.529883 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.529953 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.530007 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.531957 (+ 1950us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.532016 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":146,"threads_started":1}
I20260809 18:58:16.532075 10543 tablet_service.cc:1467] Processing CreateTablet for tablet dd96bbb235f140c6b80c5ed0d0dce547 (DEFAULT_TABLE table=test-table [id=1a88c5b6737d436fa608f55663200e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:58:16.532711 10543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd96bbb235f140c6b80c5ed0d0dce547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:16.532734 10338 tablet_service.cc:1467] Processing CreateTablet for tablet dd96bbb235f140c6b80c5ed0d0dce547 (DEFAULT_TABLE table=test-table [id=1a88c5b6737d436fa608f55663200e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:58:16.533069 10338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd96bbb235f140c6b80c5ed0d0dce547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:16.536826 10893 tablet_bootstrap.cc:492] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: Bootstrap starting.
I20260809 18:58:16.537099 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.523229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35705 (local address 127.0.0.1:38500)
0809 18:58:16.524277 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:16.524300 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:16.524370 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:16.524734 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:16.524737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:16.524741 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:16.524830 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.524833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.529078 (+ 4245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.529079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.530159 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.530161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.536815 (+ 6654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.536816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.536900 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.536906 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:58:16.536976 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:58:16.537028 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1033,"mutex_wait_us":9,"thread_start_us":126,"threads_started":1}
I20260809 18:58:16.537129 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.523590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38500 (local address 127.23.229.3:35705)
0809 18:58:16.523973 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.523978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.524460 (+ 482us) server_negotiation.cc:407] Connection header received
0809 18:58:16.524541 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.524543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.524562 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.524638 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:16.524925 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.529002 (+ 4077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.530503 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.531756 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.531824 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.531908 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.536999 (+ 5091us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.537052 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":119,"threads_started":1}
I20260809 18:58:16.537812 10750 tablet_service.cc:1467] Processing CreateTablet for tablet dd96bbb235f140c6b80c5ed0d0dce547 (DEFAULT_TABLE table=test-table [id=1a88c5b6737d436fa608f55663200e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:58:16.538182 10750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd96bbb235f140c6b80c5ed0d0dce547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:16.542461 10893 tablet_bootstrap.cc:654] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:16.542788 10893 log.cc:824] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:16.543234 10892 tablet_bootstrap.cc:492] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: Bootstrap starting.
I20260809 18:58:16.543980 10893 tablet_bootstrap.cc:492] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: No bootstrap required, opened a new log
I20260809 18:58:16.544072 10893 ts_tablet_manager.cc:1397] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260809 18:58:16.545053 10892 tablet_bootstrap.cc:654] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:16.545276 10895 tablet_bootstrap.cc:492] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Bootstrap starting.
I20260809 18:58:16.546437 10895 tablet_bootstrap.cc:654] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:16.546319 10893 raft_consensus.cc:348] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.546505 10893 raft_consensus.cc:374] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:16.546546 10893 raft_consensus.cc:729] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe0834ccb334cf389be29a2b9d8e918, State: Initialized, Role: FOLLOWER
I20260809 18:58:16.546696 10893 consensus_queue.cc:260] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.547068 10893 ts_tablet_manager.cc:1428] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:58:16.547070 10892 log.cc:824] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:16.547240 10650 heartbeater.cc:503] Master 127.23.229.62:45421 was elected leader, sending a full tablet report...
I20260809 18:58:16.547887 10895 log.cc:824] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:16.549013 10892 tablet_bootstrap.cc:492] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: No bootstrap required, opened a new log
I20260809 18:58:16.549126 10892 ts_tablet_manager.cc:1397] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260809 18:58:16.551353 10892 raft_consensus.cc:348] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.551517 10892 raft_consensus.cc:374] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:16.551561 10892 raft_consensus.cc:729] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e4c47b5641494fb71d1082900892f8, State: Initialized, Role: FOLLOWER
I20260809 18:58:16.551690 10892 consensus_queue.cc:260] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.552145 10436 heartbeater.cc:503] Master 127.23.229.62:45421 was elected leader, sending a full tablet report...
I20260809 18:58:16.552134 10892 ts_tablet_manager.cc:1428] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:58:16.553453 10895 tablet_bootstrap.cc:492] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: No bootstrap required, opened a new log
I20260809 18:58:16.553550 10895 ts_tablet_manager.cc:1397] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260809 18:58:16.554947 10895 raft_consensus.cc:348] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.555153 10895 raft_consensus.cc:374] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:16.555202 10895 raft_consensus.cc:729] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9845aabac940bb81980364db7485b9, State: Initialized, Role: FOLLOWER
I20260809 18:58:16.555330 10895 consensus_queue.cc:260] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.555812 10864 heartbeater.cc:503] Master 127.23.229.62:45421 was elected leader, sending a full tablet report...
I20260809 18:58:16.555814 10895 ts_tablet_manager.cc:1428] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260809 18:58:16.583117 10437 tablet.cc:2369] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
W20260809 18:58:16.683672 10651 tablet.cc:2369] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:58:16.727169 10866 tablet.cc:2369] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:58:16.871755 10899 raft_consensus.cc:482] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:58:16.871918 10899 raft_consensus.cc:504] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.872386 10899 leader_election.cc:288] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9845aabac940bb81980364db7485b9 (127.23.229.3:35705), 58e4c47b5641494fb71d1082900892f8 (127.23.229.1:37581)
I20260809 18:58:16.877351 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.873268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:46159 (local address 127.23.229.3:35705)
0809 18:58:16.873346 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.873347 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.873635 (+ 288us) server_negotiation.cc:407] Connection header received
0809 18:58:16.873747 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.873748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.873759 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.873789 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:16.874017 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.874800 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.876349 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.876947 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.877000 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.877010 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.877220 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.877259 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:58:16.878266 10907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.872722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:35705 (local address 127.23.229.2:46159)
0809 18:58:16.873557 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:16.873570 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:16.873666 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:16.873861 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:16.873862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:16.873864 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:16.873938 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.873940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.874949 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.874950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.876221 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.876224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.877068 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.877069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.877141 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.877145 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:58:16.878107 (+ 962us) client_negotiation.cc:240] Negotiation successful
0809 18:58:16.878164 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"thread_start_us":81,"threads_started":1}
I20260809 18:58:16.878513 10888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.873039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:49183 (local address 127.23.229.1:37581)
0809 18:58:16.873100 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.873103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.875285 (+ 2182us) server_negotiation.cc:407] Connection header received
0809 18:58:16.875397 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.875399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.875410 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.875443 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:16.875631 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.876308 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.877596 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.878123 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.878167 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.878176 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.878397 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.878449 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 18:58:16.878744 10908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.872951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:37581 (local address 127.23.229.2:49183)
0809 18:58:16.875202 (+ 2251us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:16.875215 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:16.875318 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:16.875504 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:16.875505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:16.875507 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:16.875564 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.875565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.876402 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.876403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.877481 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:16.877484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.878233 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.878233 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:16.878304 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.878308 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:58:16.878607 (+ 299us) client_negotiation.cc:240] Negotiation successful
0809 18:58:16.878653 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2236,"thread_start_us":198,"threads_started":1}
I20260809 18:58:16.878829 10784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd96bbb235f140c6b80c5ed0d0dce547" candidate_uuid: "0fe0834ccb334cf389be29a2b9d8e918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9845aabac940bb81980364db7485b9" is_pre_election: true
I20260809 18:58:16.879103 10784 raft_consensus.cc:2454] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe0834ccb334cf389be29a2b9d8e918 in term 0.
I20260809 18:58:16.879104 10363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd96bbb235f140c6b80c5ed0d0dce547" candidate_uuid: "0fe0834ccb334cf389be29a2b9d8e918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e4c47b5641494fb71d1082900892f8" is_pre_election: true
I20260809 18:58:16.879230 10363 raft_consensus.cc:2454] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe0834ccb334cf389be29a2b9d8e918 in term 0.
I20260809 18:58:16.879487 10477 leader_election.cc:302] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe0834ccb334cf389be29a2b9d8e918, 58e4c47b5641494fb71d1082900892f8; no voters:
I20260809 18:58:16.879626 10899 raft_consensus.cc:2781] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:58:16.879666 10899 raft_consensus.cc:482] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:58:16.879688 10899 raft_consensus.cc:3037] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:16.880667 10899 raft_consensus.cc:504] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.880828 10899 leader_election.cc:288] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9845aabac940bb81980364db7485b9 (127.23.229.3:35705), 58e4c47b5641494fb71d1082900892f8 (127.23.229.1:37581)
I20260809 18:58:16.888610 10363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd96bbb235f140c6b80c5ed0d0dce547" candidate_uuid: "0fe0834ccb334cf389be29a2b9d8e918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e4c47b5641494fb71d1082900892f8"
I20260809 18:58:16.888779 10363 raft_consensus.cc:3037] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:16.889617 10363 raft_consensus.cc:2454] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe0834ccb334cf389be29a2b9d8e918 in term 1.
I20260809 18:58:16.889899 10477 leader_election.cc:302] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe0834ccb334cf389be29a2b9d8e918, 58e4c47b5641494fb71d1082900892f8; no voters:
I20260809 18:58:16.889932 10784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd96bbb235f140c6b80c5ed0d0dce547" candidate_uuid: "0fe0834ccb334cf389be29a2b9d8e918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9845aabac940bb81980364db7485b9"
I20260809 18:58:16.890029 10784 raft_consensus.cc:3037] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:16.890092 10899 raft_consensus.cc:2781] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:58:16.890411 10899 raft_consensus.cc:686] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe0834ccb334cf389be29a2b9d8e918, State: Running, Role: LEADER
I20260809 18:58:16.890533 10899 consensus_queue.cc:237] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } }
I20260809 18:58:16.891144 10784 raft_consensus.cc:2454] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe0834ccb334cf389be29a2b9d8e918 in term 1.
I20260809 18:58:16.891629 10123 catalog_manager.cc:5495] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe0834ccb334cf389be29a2b9d8e918 (127.23.229.2). New cstate: current_term: 1 leader_uuid: "0fe0834ccb334cf389be29a2b9d8e918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe0834ccb334cf389be29a2b9d8e918" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 } health_report { overall_health: UNKNOWN } } }
Aug 09 18:58:16 dist-test-slave-jq4t krb5kdc[9384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301896, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:58:16.975175 10891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:16.971366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.23.229.2:45441)
0809 18:58:16.971434 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:16.971437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:16.971450 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:58:16.971499 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:16.971500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:16.971524 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:16.971610 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:58:16.971813 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.972560 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.973662 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:16.973983 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:16.974059 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:16.974440 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:58:16.974631 (+ 191us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:58:16.974724 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:16.975014 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 18:58:16.975044 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:58:16.982933 10363 raft_consensus.cc:1261] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 1 FOLLOWER]: Refusing update from remote peer 0fe0834ccb334cf389be29a2b9d8e918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:58:16.983341 10784 raft_consensus.cc:1261] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 1 FOLLOWER]: Refusing update from remote peer 0fe0834ccb334cf389be29a2b9d8e918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:58:16.983886 10909 consensus_queue.cc:1035] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9845aabac940bb81980364db7485b9" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 35705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:58:16.984067 10899 consensus_queue.cc:1035] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58e4c47b5641494fb71d1082900892f8" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 37581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:58:16.989704 10916 mvcc.cc:205] Tried to move back new op lower bound from 7316692570038263808 to 7316692569664225280. Current Snapshot: MvccSnapshot[applied={T|T < 7316692570038263808}]
I20260809 18:58:16.991206 10918 mvcc.cc:205] Tried to move back new op lower bound from 7316692570038263808 to 7316692569664225280. Current Snapshot: MvccSnapshot[applied={T|T < 7316692570038263808}]
I20260809 18:58:16.992437 10123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:58:16.992578 10123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:58:16.993381 10123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d39bb17d9774b60923ecff1fe8e0da3: Sending DeleteTablet for 3 replicas of tablet dd96bbb235f140c6b80c5ed0d0dce547
I20260809 18:58:16.993767 10750 tablet_service.cc:1514] Processing DeleteTablet for tablet dd96bbb235f140c6b80c5ed0d0dce547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:58:16 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:38500
I20260809 18:58:16.993819 10338 tablet_service.cc:1514] Processing DeleteTablet for tablet dd96bbb235f140c6b80c5ed0d0dce547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:58:16 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:55290
I20260809 18:58:16.994093 10926 tablet_replica.cc:330] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8: stopping tablet replica
I20260809 18:58:16.994226 10926 raft_consensus.cc:2229] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:58:16.994316 10926 raft_consensus.cc:2258] T dd96bbb235f140c6b80c5ed0d0dce547 P 58e4c47b5641494fb71d1082900892f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:58:16.994540 10543 tablet_service.cc:1514] Processing DeleteTablet for tablet dd96bbb235f140c6b80c5ed0d0dce547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:58:16 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:44018
I20260809 18:58:16.994786 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 10249
W20260809 18:58:17.009289 10101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:37581 (error 108)
I20260809 18:58:17.011863 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:17.011718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:37581 (local address 127.0.0.1:55300)
0809 18:58:17.011778 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:17.011815 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:37581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 18:58:17.012202 10101 catalog_manager.cc:4584] TS 58e4c47b5641494fb71d1082900892f8 (127.23.229.1:37581): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd96bbb235f140c6b80c5ed0d0dce547: Network error: Client connection negotiation failed: client connection to 127.23.229.1:37581: connect: Connection refused (error 111)
I20260809 18:58:17.012614 10928 tablet_replica.cc:330] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918: stopping tablet replica
I20260809 18:58:17.012771 10928 raft_consensus.cc:2229] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:58:17.012822 10927 tablet_replica.cc:330] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: stopping tablet replica
I20260809 18:58:17.012926 10928 raft_consensus.cc:2258] T dd96bbb235f140c6b80c5ed0d0dce547 P 0fe0834ccb334cf389be29a2b9d8e918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:58:17.012987 10927 raft_consensus.cc:2229] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:58:17.012982 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 10447
I20260809 18:58:17.020988 10927 raft_consensus.cc:2258] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:58:17.022979 10927 ts_tablet_manager.cc:1905] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:58:17.025266 10927 ts_tablet_manager.cc:1918] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:58:17.025377 10927 log.cc:1196] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/dd96bbb235f140c6b80c5ed0d0dce547
I20260809 18:58:17.025695 10927 ts_tablet_manager.cc:1939] T dd96bbb235f140c6b80c5ed0d0dce547 P 4c9845aabac940bb81980364db7485b9: Deleting consensus metadata
I20260809 18:58:17.026295 10103 catalog_manager.cc:4841] TS 4c9845aabac940bb81980364db7485b9 (127.23.229.3:35705): tablet dd96bbb235f140c6b80c5ed0d0dce547 (table test-table [id=1a88c5b6737d436fa608f55663200e83]) successfully deleted
I20260809 18:58:17.035660 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:17.035517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:45441 (local address 127.0.0.1:44042)
0809 18:58:17.035581 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:17.035606 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.2:45441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 18:58:17.036401 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 10656
I20260809 18:58:17.061800 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 10081
I20260809 18:58:17.083590 24468 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 18:58:17.441582 24468 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 18:58:17.441699 24468 mini_ranger.cc:66] Stopping Ranger...
I20260809 18:58:17.797857 24468 mini_ranger.cc:68] Stopped Ranger
2026-08-09 18:58:17.798 UTC [9432] LOG: received smart shutdown request
2026-08-09 18:58:17.803 UTC [9432] LOG: background worker "logical replication launcher" (PID 9446) exited with exit code 1
2026-08-09 18:58:17.803 UTC [9440] LOG: shutting down
2026-08-09 18:58:17.978 UTC [9432] LOG: database system is shut down
2026-08-09T18:58:17Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48249 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:58:18 dist-test-slave-jq4t krb5kdc[10944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:58:18 dist-test-slave-jq4t krb5kdc[10944](info): set up 2 sockets
Aug 09 18:58:18 dist-test-slave-jq4t krb5kdc[10944](info): commencing operation
krb5kdc: starting...
W20260809 18:58:19.342842 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:58:19 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:58:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:58:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/rangeradmin_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/rangeradmin_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/rangerlookup_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/rangerlookup_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
I20260809 18:58:19.514391 24468 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskI_GCfH/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/postgres -l logfile start
2026-08-09 18:58:22.029 UTC [10989] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 18:58:22.029 UTC [10989] LOG: listening on IPv4 address "127.23.229.20", port 57669
2026-08-09 18:58:22.033 UTC [10989] LOG: listening on Unix socket "/tmp/.s.PGSQL.57669"
2026-08-09 18:58:22.055 UTC [10992] LOG: database system was shut down at 2026-08-09 18:58:20 UTC
2026-08-09 18:58:22.059 UTC [10989] LOG: database system is ready to accept connections
I20260809 18:58:23.209872 24468 mini_postgres.cc:96] Postgres bound to 57669
2026-08-09 18:58:23.217 UTC [11001] FATAL: database "slave" does not exist
127.23.229.20:57669 - accepting connections
I20260809 18:58:23.217892 24468 mini_ranger.cc:161] Starting Ranger...
I20260809 18:58:23.234520 24468 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 18:58:23.718169 24468 mini_ranger.cc:87] Created ranger Postgres database
I20260809 18:58:23.718264 24468 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-admin
2026-08-09 18:58:23,994 [I] DB FLAVOR :POSTGRES
2026-08-09 18:58:23,994 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:58:23,995 [I] Checking connection..
2026-08-09 18:58:23,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 18:58:24,266 [I] Checking connection passed.
2026-08-09 18:58:24,267 [I] --------- Verifying version history table ---------
2026-08-09 18:58:24,267 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:58:24,540 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:58:24,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:58:24,814 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:58:24,814 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 18:58:24,814 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 18:58:25.061 UTC [11097] WARNING: there is no transaction in progress
2026-08-09 18:58:25,068 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 18:58:25,068 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:58:25,333 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 18:58:25,333 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:58:25,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 18:58:25,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 18:58:25,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-09 18:58:26,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:58:26,339 [I] Table x_portal_user does not exist in database ranger
2026-08-09 18:58:26,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:58:26,581 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 18:58:26,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:58:26,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:58:27,079 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 18:58:27,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 18:58:28.104 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.121 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.139 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.155 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.171 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.188 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.245 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.252 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.267 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.278 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.288 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.303 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.312 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.319 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.325 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28.333 UTC [11258] WARNING: there is no transaction in progress
2026-08-09 18:58:28,967 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 18:58:28,967 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 18:58:29,230 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 18:58:29,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:58:29,498 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 18:58:29,498 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:58:29,749 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 18:58:29,749 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:58:29,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:58:30,271 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-09 18:58:30,511 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 18:58:30,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 18:58:30,780 [I] DB_PATCHES have already been applied
I20260809 18:58:30.786846 24468 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-admin:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskI_GCfH/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 18:58:30.786921 24468 mini_ranger.cc:193] Using host: 127.23.229.20
I20260809 18:58:30.790956 24468 mini_ranger.cc:227] Ranger admin URL: http://127.23.229.20:35047
Aug 09, 2026 6:58:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:58:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:58:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:58:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:58:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:58:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:58:31 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 18:58:32.158229 24468 mini_ranger.cc:160] Time spent starting Ranger: real 8.940s user 0.003s sys 0.008s
Aug 09, 2026 6:58:53 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:58:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 6:58:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:58:53 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:58:54 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 18:58:54.857561 24468 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.229.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.229.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/rangerkms_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.229.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/rangerkms_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.229.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.229.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.229.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/HTTP_127.23.229.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 18:58:54 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301934, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 18:58:54.948796 24468 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 18:58:54.959059 24468 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 18:58:55.825541 24468 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 18:58:55.825644 24468 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms
I20260809 18:58:55.825666 24468 mini_ranger_kms.cc:227] Using postgres at 127.23.229.20:57669
2026-08-09 18:58:56,020 [I] DB FLAVOR :POSTGRES
2026-08-09 18:58:56,021 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:58:56,021 [I] Checking connection
2026-08-09 18:58:56,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 18:58:56,267 [I] connection success
2026-08-09 18:58:56,267 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 18:58:56,267 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 18:58:56,267 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 18:58:56,513 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 18:58:56,514 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:58:56,514 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 18:58:56,514 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.229.20:57669/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 18:58:56,791 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 18:58:57.341753 24468 mini_ranger_kms.cc:310] Created kms service
I20260809 18:58:57.524617 24468 mini_ranger_kms.cc:326] Created kudu user
I20260809 18:58:57.571812 24468 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 18:58:57 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301934, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:58:58.042685 24468 mini_ranger_kms.cc:384] Added ranger policy
I20260809 18:58:58.042932 24468 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms:/tmp/dist-test-taskI_GCfH/build/release/bin/postgresql.jar:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskI_GCfH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 18:58:58.042955 24468 mini_ranger_kms.cc:240] Using host: 127.23.229.20
I20260809 18:58:58.048311 24468 mini_ranger_kms.cc:276] Ranger KMS PID: 11528
I20260809 18:58:58.048418 24468 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.229.20:38635
Aug 09, 2026 6:58:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:58:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:58:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:58:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:58:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:58:59 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 18:59:00 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301940, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.229.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:00.724184 24468 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.775s user 0.018s sys 0.156s
I20260809 18:59:00.724303 24468 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 18:59:00.724359 24468 mini_ranger_kms.cc:401] 127.23.229.20:38635/kms/v1/keys
Aug 09 18:59:00 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301940, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.229.20@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
Aug 09 18:59:01 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301940, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.229.20@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
Aug 09 18:59:03 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301943, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:59:03.692679 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43809
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43809
--ranger_config_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:03.781567 11599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:03.781777 11599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:03.781800 11599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:03.782938 11599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:03.782976 11599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:03.782990 11599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:03.783003 11599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:03.783016 11599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:03.784765 11599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.229.20:38635/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43809
--ranger_config_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:03.785005 11599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:03.785228 11599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:03.791199 11607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:03.791251 11599 server_base.cc:1034] running on GCE node
W20260809 18:59:03.791270 11608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:03.791270 11611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:03.791774 11599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:03.792100 11599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:03.793246 11599 hybrid_clock.cc:648] HybridClock initialized: now 1786301943793223 us; error 38 us; skew 500 ppm
Aug 09 18:59:03 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301943, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:03.796418 11599 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:03.796970 11599 webserver.cc:460] Webserver started at http://127.23.229.62:44795/ using document root <none> and password file <none>
I20260809 18:59:03.797199 11599 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:03.797237 11599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:03.797333 11599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:03 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301943, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:03.854691 11599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "e029d2b876054579aea285c987cb948d"
format_stamp: "Formatted at 2026-08-09 18:59:03 on dist-test-slave-jq4t"
server_key: "bf6731ddbb1d91f2f0aed86e382ef4c4"
server_key_iv: "a30f3a7294741697239c31cdc0eea17d"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:03.855192 11599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "e029d2b876054579aea285c987cb948d"
format_stamp: "Formatted at 2026-08-09 18:59:03 on dist-test-slave-jq4t"
server_key: "bf6731ddbb1d91f2f0aed86e382ef4c4"
server_key_iv: "a30f3a7294741697239c31cdc0eea17d"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:03.857085 11599 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 18:59:03.872954 11624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:03.873219 11599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:03.873363 11599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "e029d2b876054579aea285c987cb948d"
format_stamp: "Formatted at 2026-08-09 18:59:03 on dist-test-slave-jq4t"
server_key: "bf6731ddbb1d91f2f0aed86e382ef4c4"
server_key_iv: "a30f3a7294741697239c31cdc0eea17d"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:03.873487 11599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:03.912098 11599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:03.914345 11599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:03.914513 11599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:03.919963 11599 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43809
I20260809 18:59:03.920056 11696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43809 every 8 connection(s)
I20260809 18:59:03.920500 11599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:03.921274 11698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:03.923633 11698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Bootstrap starting.
I20260809 18:59:03.924263 11698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:03.924641 11698 log.cc:824] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:03.925432 11698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: No bootstrap required, opened a new log
I20260809 18:59:03.927558 11698 raft_consensus.cc:348] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:03.927734 11698 raft_consensus.cc:374] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:03.927788 11698 raft_consensus.cc:729] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e029d2b876054579aea285c987cb948d, State: Initialized, Role: FOLLOWER
I20260809 18:59:03.927945 11698 consensus_queue.cc:260] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:03.928035 11698 raft_consensus.cc:388] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:03.928078 11698 raft_consensus.cc:482] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:03.928140 11698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:03.928776 11698 raft_consensus.cc:504] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:03.928902 11698 leader_election.cc:302] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e029d2b876054579aea285c987cb948d; no voters:
I20260809 18:59:03.929082 11698 leader_election.cc:288] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:59:03.929109 11702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:03.929302 11702 raft_consensus.cc:686] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 LEADER]: Becoming Leader. State: Replica: e029d2b876054579aea285c987cb948d, State: Running, Role: LEADER
I20260809 18:59:03.929446 11698 sys_catalog.cc:564] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:03.929487 11702 consensus_queue.cc:237] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:03.929838 11702 sys_catalog.cc:455] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e029d2b876054579aea285c987cb948d. Latest consensus state: current_term: 1 leader_uuid: "e029d2b876054579aea285c987cb948d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } } }
I20260809 18:59:03.930154 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 11599
I20260809 18:59:03.930274 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:59:03.930467 24468 external_mini_cluster.cc:1428] Setting key 954d1bf79137bbd8da84f2441204deee
I20260809 18:59:03.929885 11704 sys_catalog.cc:455] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e029d2b876054579aea285c987cb948d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } } }
I20260809 18:59:03.931293 11702 sys_catalog.cc:458] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:03.931342 11704 sys_catalog.cc:458] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:03.931187 11698 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 18:59:03.931762 11722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:03.934875 11722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:03.938585 11722 catalog_manager.cc:1347] Generated new cluster ID: b2a8ca1f3bb14233a45ccab64e4d1cf1
I20260809 18:59:03.938644 11722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:59:03 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301943, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:03.949326 11721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:03.930981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57672 (local address 127.23.229.62:43809)
0809 18:59:03.935484 (+ 4503us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:03.935515 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:03.935579 (+ 64us) server_negotiation.cc:407] Connection header received
0809 18:59:03.935844 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:03.935856 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:03.935936 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:03.937045 (+ 1109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:03.937316 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:03.939143 (+ 1827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:03.940336 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:03.941137 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:03.941619 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:03.944568 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:03.944573 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:03.944574 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:03.944588 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:03.946894 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:03.947387 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:03.947391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:03.947392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:03.947506 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:03.947714 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:03.947715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:03.947715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:03.948069 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:03.948738 (+ 669us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:03.948831 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 18:59:03.948991 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4360,"thread_start_us":107,"threads_started":1}
I20260809 18:59:03.980463 11722 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:03.981376 11722 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:03.987565 11722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Generated new TSK 0
I20260809 18:59:03.987874 11722 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:59:04.663671 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43809
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:04.792366 11766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:04.792712 11766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:04.792752 11766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:04.794490 11766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:04.794559 11766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:04.794603 11766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:59:04.796923 11766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.229.20:38635/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:04.797200 11766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:04.797511 11766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:04.803512 11776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:04.803478 11779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:04.803650 11781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:04.804497 11766 server_base.cc:1034] running on GCE node
I20260809 18:59:04.804718 11766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:04.805001 11766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:04.806165 11766 hybrid_clock.cc:648] HybridClock initialized: now 1786301944806154 us; error 31 us; skew 500 ppm
Aug 09 18:59:04 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301944, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:04.808964 11766 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:59:04.809463 11766 webserver.cc:460] Webserver started at http://127.23.229.1:32927/ using document root <none> and password file <none>
I20260809 18:59:04.809705 11766 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:04.809742 11766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:04.810024 11766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:04 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301944, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:04.823982 11766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a"
format_stamp: "Formatted at 2026-08-09 18:59:04 on dist-test-slave-jq4t"
server_key: "8b1184b7452fce0b4ba16b7c4a38bb49"
server_key_iv: "47b5f3cb805f2774231bc72448c547f4"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:04.824457 11766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a"
format_stamp: "Formatted at 2026-08-09 18:59:04 on dist-test-slave-jq4t"
server_key: "8b1184b7452fce0b4ba16b7c4a38bb49"
server_key_iv: "47b5f3cb805f2774231bc72448c547f4"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:04.826646 11766 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260809 18:59:04.840849 11794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:04.841084 11766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:04.841194 11766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a"
format_stamp: "Formatted at 2026-08-09 18:59:04 on dist-test-slave-jq4t"
server_key: "8b1184b7452fce0b4ba16b7c4a38bb49"
server_key_iv: "47b5f3cb805f2774231bc72448c547f4"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:04.841315 11766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:04.878111 11766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:04.880576 11766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:04.880743 11766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:04.881001 11766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:04.881349 11766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:04.881402 11766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:04.881448 11766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:04.881474 11766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:04.886987 11766 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:39137
I20260809 18:59:04.887416 11766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:04.892297 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 11766
I20260809 18:59:04.892408 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:59:04.892618 24468 external_mini_cluster.cc:1428] Setting key a13bae9d6f05e421618b415660129163
I20260809 18:59:04.897852 11991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:39137 every 8 connection(s)
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Aug 09 18:59:04 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301944, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:04.911629 11998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:04.899415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43809 (local address 127.23.229.1:57465)
0809 18:59:04.899676 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:04.899732 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:04.900437 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:04.900896 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:04.900901 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:04.901167 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:04.901505 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:04.901513 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:04.902587 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:04.902589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:04.903959 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:04.903962 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:04.904428 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:04.904429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:04.904660 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:04.905401 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:04.905411 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:04.907317 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:04.909650 (+ 2333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:04.909660 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:04.909663 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:04.910021 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:04.910275 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:04.910276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:04.910277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:04.910450 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:04.910826 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:04.910833 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:04.911023 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 18:59:04.911147 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 18:59:04.911336 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":164,"threads_started":1}
I20260809 18:59:04.912143 11997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:04.899453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:57465 (local address 127.23.229.62:43809)
0809 18:59:04.900613 (+ 1160us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:04.900616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:04.900627 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:04.900662 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:04.900663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:04.900679 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:04.900772 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:04.901635 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:04.902480 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:04.904054 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:04.904258 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:04.904323 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:04.907476 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:04.907478 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:04.907479 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:04.907488 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:04.909538 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:04.910124 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:04.910125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:04.910126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:04.910198 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:04.910540 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:04.910541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:04.910542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:04.910711 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:04.910782 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:04.911922 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0809 18:59:04.912030 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1118,"thread_start_us":87,"threads_started":1}
I20260809 18:59:04.912582 11992 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43809
I20260809 18:59:04.912694 11992 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:04.912912 11992 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:04.913504 11650 ts_manager.cc:194] Registered new tserver with Master: 97c55bba9cd04e1c971ad82d1e4f8e3a (127.23.229.1:39137)
I20260809 18:59:04.914402 11650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:57465
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:59:04.926144 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43809
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:05.033838 12002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:05.034178 12002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:05.034287 12002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:05.035817 12002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:05.035887 12002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:05.035933 12002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:59:05.038223 12002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.229.20:38635/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:05.038512 12002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:05.038865 12002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:05.045334 12012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:05.045336 12013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:05.045645 12016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:05.046487 12002 server_base.cc:1034] running on GCE node
I20260809 18:59:05.046731 12002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:05.047055 12002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:05.048233 12002 hybrid_clock.cc:648] HybridClock initialized: now 1786301945048204 us; error 43 us; skew 500 ppm
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:05.052124 12002 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:59:05.052760 12002 webserver.cc:460] Webserver started at http://127.23.229.2:44921/ using document root <none> and password file <none>
I20260809 18:59:05.053052 12002 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:05.053133 12002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:05.053337 12002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:05.088150 12002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "916af5cff6d447d0a9119cfa193773e2"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "203c53bc8dc66565f2dfde4debd40a8c"
server_key_iv: "05a503477840bb8585a6562e09bccf54"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.088858 12002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "916af5cff6d447d0a9119cfa193773e2"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "203c53bc8dc66565f2dfde4debd40a8c"
server_key_iv: "05a503477840bb8585a6562e09bccf54"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.092195 12002 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260809 18:59:05.116693 12026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.117000 12002 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260809 18:59:05.117131 12002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "916af5cff6d447d0a9119cfa193773e2"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "203c53bc8dc66565f2dfde4debd40a8c"
server_key_iv: "05a503477840bb8585a6562e09bccf54"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.117241 12002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:05.133535 12002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:05.136622 12002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:05.136866 12002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:05.137245 12002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:05.137732 12002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:05.137832 12002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.137907 12002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:05.137966 12002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.145862 12002 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:36933
I20260809 18:59:05.146632 12002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:05.149288 12194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:36933 every 8 connection(s)
I20260809 18:59:05.155750 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 12002
I20260809 18:59:05.155860 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:59:05.156083 24468 external_mini_cluster.cc:1428] Setting key 0a167996a7ec4f4fd8f5f467c1fe20a6
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:05.165383 11997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:05.150227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:41177 (local address 127.23.229.62:43809)
0809 18:59:05.150279 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:05.150281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:05.150866 (+ 585us) server_negotiation.cc:407] Connection header received
0809 18:59:05.151634 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:05.151635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:05.151654 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:05.151689 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:05.152646 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.153489 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.155091 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.155424 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.155493 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:05.161645 (+ 6152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:05.161647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:05.161648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:05.161656 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:05.163532 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:05.164080 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:05.164081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:05.164082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:05.164147 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:05.164462 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:05.164463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:05.164463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:05.164646 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:05.164699 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:05.165140 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 18:59:05.165254 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:59:05.165967 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:05.149911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43809 (local address 127.23.229.2:41177)
0809 18:59:05.150568 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:05.150750 (+ 182us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:05.151488 (+ 738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:05.151897 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:05.151902 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:05.152192 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:05.152522 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:05.152530 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.153620 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.153621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:05.154961 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:05.154965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.156593 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.156594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:05.156755 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:05.159650 (+ 2895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:05.159663 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:05.161503 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:05.163643 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:05.163650 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:05.163654 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:05.163968 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:05.164221 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:05.164222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:05.164223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:05.164378 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:05.164756 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:05.164763 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:05.164949 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 18:59:05.165573 (+ 624us) client_negotiation.cc:240] Negotiation successful
0809 18:59:05.165768 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":85,"threads_started":1}
I20260809 18:59:05.166530 12195 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43809
I20260809 18:59:05.166661 12195 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:05.166882 12195 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:05.167325 11650 ts_manager.cc:194] Registered new tserver with Master: 916af5cff6d447d0a9119cfa193773e2 (127.23.229.2:36933)
I20260809 18:59:05.167716 11650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:41177
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:59:05.203755 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43809
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:05.335374 12200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:05.335772 12200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:05.335896 12200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:05.337769 12200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:05.338032 12200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:05.338138 12200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:59:05.339972 12200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.229.20:38635/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:05.340291 12200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:05.340647 12200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:05.347265 12214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:05.347474 12212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:05.347692 12211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:05.348088 12200 server_base.cc:1034] running on GCE node
I20260809 18:59:05.348354 12200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:05.348690 12200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:05.349879 12200 hybrid_clock.cc:648] HybridClock initialized: now 1786301945349854 us; error 38 us; skew 500 ppm
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:05.353365 12200 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:59:05.353940 12200 webserver.cc:460] Webserver started at http://127.23.229.3:38093/ using document root <none> and password file <none>
I20260809 18:59:05.354247 12200 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:05.354313 12200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:05.354473 12200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:05.370203 12200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "c6b38fe08151425fa889f3594780eaca"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "dd949565d7e4ec95a9af2c97ccceb97d"
server_key_iv: "91f9c6909c5ce594d6242e9795ebb33a"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.370817 12200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "c6b38fe08151425fa889f3594780eaca"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "dd949565d7e4ec95a9af2c97ccceb97d"
server_key_iv: "91f9c6909c5ce594d6242e9795ebb33a"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.378196 12200 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.001s
I20260809 18:59:05.404959 12222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.405273 12200 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:59:05.405393 12200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "c6b38fe08151425fa889f3594780eaca"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "dd949565d7e4ec95a9af2c97ccceb97d"
server_key_iv: "91f9c6909c5ce594d6242e9795ebb33a"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.405512 12200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:05.424718 12200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:05.427522 12200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:05.427794 12200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:05.428153 12200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:05.428685 12200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:05.428790 12200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.428875 12200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:05.428956 12200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.439284 12200 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:37369
I20260809 18:59:05.439852 12200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:05.441330 12388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:37369 every 8 connection(s)
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:05.449544 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 12200
I20260809 18:59:05.449661 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:59:05.449891 24468 external_mini_cluster.cc:1428] Setting key f7bebf4ffdcec6bf838506bde6e49357
I20260809 18:59:05.452919 11997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:05.441593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:39499 (local address 127.23.229.62:43809)
0809 18:59:05.441646 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:05.441648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:05.441885 (+ 237us) server_negotiation.cc:407] Connection header received
0809 18:59:05.442644 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:05.442647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:05.442662 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:05.442698 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:05.443633 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.444466 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.446129 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.446418 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.446468 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:05.449341 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:05.449342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:05.449343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:05.449350 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:05.451174 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:05.451693 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:05.451694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:05.451695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:05.451757 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:05.452082 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:05.452083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:05.452083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:05.452233 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:05.452278 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:05.452720 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 18:59:05.452809 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:59:05.453771 12393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:05.441450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43809 (local address 127.23.229.3:39499)
0809 18:59:05.441737 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:05.441788 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:05.442497 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:05.442926 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:05.442931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:05.443202 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:05.443502 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:05.443509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.444676 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.444678 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:05.446015 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:05.446018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.446585 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.446587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:05.446758 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:05.447443 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:05.447455 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:05.449226 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:05.451279 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:05.451286 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:05.451288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:05.451595 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:05.451835 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:05.451836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:05.451836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:05.451992 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:05.452328 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:05.452336 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:05.452547 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 18:59:05.453329 (+ 782us) client_negotiation.cc:240] Negotiation successful
0809 18:59:05.453519 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":85,"threads_started":1}
I20260809 18:59:05.454615 12389 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43809
I20260809 18:59:05.454716 12389 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:05.454939 12389 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:05.455420 11650 ts_manager.cc:194] Registered new tserver with Master: c6b38fe08151425fa889f3594780eaca (127.23.229.3:37369)
I20260809 18:59:05.455947 11650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:39499
I20260809 18:59:05.461748 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:05.462531 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 11766
I20260809 18:59:05.497821 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 12002
I20260809 18:59:05.531687 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 12200
I20260809 18:59:05.541944 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 11599
I20260809 18:59:05.560457 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43809
--webserver_interface=127.23.229.62
--webserver_port=44795
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43809
--ranger_config_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:05.649094 12396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:05.649327 12396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:05.649349 12396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:05.650540 12396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:05.650589 12396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:05.650604 12396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:05.650616 12396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:05.650629 12396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:05.652359 12396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43809
--ranger_config_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=44795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:05.652679 12396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:05.652943 12396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:05.659176 12405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:05.659184 12407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:05.659436 12396 server_base.cc:1034] running on GCE node
W20260809 18:59:05.659502 12402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:05.659804 12396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:05.660192 12396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:05.661352 12396 hybrid_clock.cc:648] HybridClock initialized: now 1786301945661331 us; error 42 us; skew 500 ppm
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:05.664072 12396 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:05.664686 12396 webserver.cc:460] Webserver started at http://127.23.229.62:44795/ using document root <none> and password file <none>
I20260809 18:59:05.664970 12396 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:05.665027 12396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:05.708853 12396 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:59:05.709764 12421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.710057 12396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:05.710165 12396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "e029d2b876054579aea285c987cb948d"
format_stamp: "Formatted at 2026-08-09 18:59:03 on dist-test-slave-jq4t"
server_key: "bf6731ddbb1d91f2f0aed86e382ef4c4"
server_key_iv: "a30f3a7294741697239c31cdc0eea17d"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.710652 12396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:05.742439 12396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:05.746775 12396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:05.746975 12396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:05.753134 12396 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43809
I20260809 18:59:05.753178 12496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43809 every 8 connection(s)
I20260809 18:59:05.753599 12396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:05.755636 12499 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:59:05.756769 12499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Bootstrap starting.
I20260809 18:59:05.758307 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 12396
I20260809 18:59:05.758675 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:39137
--local_ip_for_outbound_sockets=127.23.229.1
--tserver_master_addrs=127.23.229.62:43809
--webserver_port=32927
--webserver_interface=127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:05.768728 12499 log.cc:824] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:05.770866 12499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:05.771128 12499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Bootstrap complete.
I20260809 18:59:05.773681 12499 raft_consensus.cc:348] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:05.773922 12499 raft_consensus.cc:729] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e029d2b876054579aea285c987cb948d, State: Initialized, Role: FOLLOWER
I20260809 18:59:05.774111 12499 consensus_queue.cc:260] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:05.774183 12499 raft_consensus.cc:388] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:05.774248 12499 raft_consensus.cc:482] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:05.774298 12499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:59:05.775327 12499 raft_consensus.cc:504] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:05.775454 12499 leader_election.cc:302] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e029d2b876054579aea285c987cb948d; no voters:
I20260809 18:59:05.775648 12499 leader_election.cc:288] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:59:05.775709 12508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:59:05.775861 12508 raft_consensus.cc:686] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [term 2 LEADER]: Becoming Leader. State: Replica: e029d2b876054579aea285c987cb948d, State: Running, Role: LEADER
I20260809 18:59:05.775933 12499 sys_catalog.cc:564] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:05.775992 12508 consensus_queue.cc:237] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } }
I20260809 18:59:05.776278 12508 sys_catalog.cc:455] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e029d2b876054579aea285c987cb948d. Latest consensus state: current_term: 2 leader_uuid: "e029d2b876054579aea285c987cb948d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } } }
I20260809 18:59:05.776401 12508 sys_catalog.cc:458] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:05.776279 12510 sys_catalog.cc:455] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e029d2b876054579aea285c987cb948d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e029d2b876054579aea285c987cb948d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43809 } } }
I20260809 18:59:05.776578 12510 sys_catalog.cc:458] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:05.777508 12499 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 18:59:05.777880 12516 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:05.780903 12516 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:05.781280 12516 catalog_manager.cc:1259] Loaded cluster ID: b2a8ca1f3bb14233a45ccab64e4d1cf1
I20260809 18:59:05.781388 12516 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:05.783232 12516 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:05.783463 12516 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Loaded TSK: 0
I20260809 18:59:05.783802 12516 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:59:05.882691 12504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:05.882988 12504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:05.883072 12504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:05.884953 12504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:05.885056 12504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:05.885140 12504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:59:05.887408 12504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:39137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=32927
--tserver_master_addrs=127.23.229.62:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:05.887809 12504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:05.888110 12504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:05.895756 12553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:05.896070 12552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:05.896134 12504 server_base.cc:1034] running on GCE node
W20260809 18:59:05.896247 12555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:05.896613 12504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:05.896922 12504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:05.898097 12504 hybrid_clock.cc:648] HybridClock initialized: now 1786301945898061 us; error 51 us; skew 500 ppm
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:05.901710 12504 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:59:05.902354 12504 webserver.cc:460] Webserver started at http://127.23.229.1:32927/ using document root <none> and password file <none>
I20260809 18:59:05.902689 12504 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:05.902776 12504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:05.931879 12504 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.000s
I20260809 18:59:05.933094 12571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.933332 12504 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:05.933459 12504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a"
format_stamp: "Formatted at 2026-08-09 18:59:04 on dist-test-slave-jq4t"
server_key: "8b1184b7452fce0b4ba16b7c4a38bb49"
server_key_iv: "47b5f3cb805f2774231bc72448c547f4"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:05.933979 12504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:05.954840 12504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:05.957190 12504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:05.957430 12504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:05.957741 12504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:05.958215 12504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:05.958268 12504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.958298 12504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:05.958318 12504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:05.966302 12504 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:39137
I20260809 18:59:05.966409 12746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:39137 every 8 connection(s)
I20260809 18:59:05.966918 12504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:59:05 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301945, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:05.976724 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 12504
I20260809 18:59:05.977073 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:36933
--local_ip_for_outbound_sockets=127.23.229.2
--tserver_master_addrs=127.23.229.62:43809
--webserver_port=44921
--webserver_interface=127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:05.980994 12754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:05.967923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:55891 (local address 127.23.229.62:43809)
0809 18:59:05.968143 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:05.968153 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:05.968195 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:59:05.968931 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:05.968937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:05.968983 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:05.969108 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:05.969914 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.970862 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.972371 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.972821 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.972906 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:05.975327 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:05.975331 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:05.975332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:05.975342 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:05.977637 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:05.978185 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:05.978189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:05.978189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:05.978336 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:05.979888 (+ 1552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:05.979889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:05.979889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:05.980178 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:05.980277 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:05.980635 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 18:59:05.980763 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":108,"threads_started":1}
I20260809 18:59:05.981007 12753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:05.967735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43809 (local address 127.23.229.1:55891)
0809 18:59:05.967926 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:05.967980 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:05.968693 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:05.969200 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:05.969205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:05.969480 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:05.969783 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:05.969790 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.970974 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.970975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:05.972274 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:05.972277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:05.972929 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:05.972930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:05.973081 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:05.973673 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:05.973685 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:05.975200 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:05.977736 (+ 2536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:05.977743 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:05.977746 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:05.978075 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:05.978421 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:05.978422 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:05.978423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:05.979790 (+ 1367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:05.980255 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:05.980263 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:05.980408 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 18:59:05.980570 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 18:59:05.980763 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260809 18:59:05.982060 12749 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43809
I20260809 18:59:05.982242 12749 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:05.982504 12749 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
W20260809 18:59:05.983773 12749 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:43809 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:59:05.983945 12749 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:05.984071 12749 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:05.984438 12749 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:05.984625 12749 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
W20260809 18:59:05.985028 12749 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:59:06.110908 12755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:06.111227 12755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:06.111272 12755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:06.113175 12755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:06.113248 12755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:06.113296 12755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:59:06.115784 12755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:36933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=44921
--tserver_master_addrs=127.23.229.62:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:06.116108 12755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:06.116468 12755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:06.123425 12760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:06.123458 12762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:06.123890 12764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:06.124348 12755 server_base.cc:1034] running on GCE node
I20260809 18:59:06.124619 12755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:06.124933 12755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:06.126130 12755 hybrid_clock.cc:648] HybridClock initialized: now 1786301946126098 us; error 45 us; skew 500 ppm
Aug 09 18:59:06 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:06.129576 12755 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:59:06.130187 12755 webserver.cc:460] Webserver started at http://127.23.229.2:44921/ using document root <none> and password file <none>
I20260809 18:59:06.130520 12755 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:06.130609 12755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:06 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:06.150444 12755 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:06.151579 12779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:06.151791 12755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:06.151898 12755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "916af5cff6d447d0a9119cfa193773e2"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "203c53bc8dc66565f2dfde4debd40a8c"
server_key_iv: "05a503477840bb8585a6562e09bccf54"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:06.152302 12755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:06.161584 12755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:06.164170 12755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:06.164361 12755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:06.164678 12755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:06.165196 12755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:06.165253 12755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:06.165299 12755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:06.165326 12755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:06.172423 12755 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:36933
I20260809 18:59:06.172624 12953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:36933 every 8 connection(s)
I20260809 18:59:06.172971 12755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:59:06 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:06.180693 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 12755
I20260809 18:59:06.181046 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.229.20:38635/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:37369
--local_ip_for_outbound_sockets=127.23.229.3
--tserver_master_addrs=127.23.229.62:43809
--webserver_port=38093
--webserver_interface=127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:06.187515 12754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:06.173840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43173 (local address 127.23.229.62:43809)
0809 18:59:06.173922 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:06.173924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:06.174104 (+ 180us) server_negotiation.cc:407] Connection header received
0809 18:59:06.174604 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:06.174605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:06.174625 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:06.174708 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:06.175371 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.176021 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.177852 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.178174 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.178270 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:06.183571 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:06.183574 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:06.183574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:06.183584 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:06.185542 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:06.186165 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:06.186167 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:06.186167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:06.186238 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:06.186587 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:06.186588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:06.186589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:06.186757 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:06.186815 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:06.187295 (+ 480us) server_negotiation.cc:299] Negotiation successful
0809 18:59:06.187406 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:59:06.188177 12960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:06.173788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43809 (local address 127.23.229.2:43173)
0809 18:59:06.173962 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:06.174006 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:06.174502 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:06.174799 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:06.174802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:06.174991 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:06.175271 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:06.175277 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.176135 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.176136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:06.177746 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:06.177749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.178315 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.178317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:06.178486 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:06.179195 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:06.179207 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:06.183417 (+ 4210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:06.185662 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:06.185674 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:06.185677 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:06.186054 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:06.186326 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:06.186327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:06.186327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:06.186491 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:06.186882 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:06.186890 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:06.187103 (+ 213us) client_negotiation.cc:769] Sending connection context
0809 18:59:06.187695 (+ 592us) client_negotiation.cc:240] Negotiation successful
0809 18:59:06.187908 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260809 18:59:06.188753 12954 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43809
I20260809 18:59:06.188874 12954 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:06.189112 12954 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
W20260809 18:59:06.189853 12954 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:43809 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:59:06.189949 12954 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:06.190030 12954 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:06.190371 12954 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:06.190465 12954 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
W20260809 18:59:06.190827 12954 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:59:06.298933 12962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:06.299242 12962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:06.299281 12962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:06.301149 12962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:06.301223 12962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:06.301265 12962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:59:06.303629 12962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.229.20:38635/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:37369
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=38093
--tserver_master_addrs=127.23.229.62:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:06.303915 12962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:06.304212 12962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:06.311744 12976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:06.312050 12970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:06.312239 12962 server_base.cc:1034] running on GCE node
W20260809 18:59:06.312701 12971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:06.314513 12962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:06.314841 12962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:06.318116 12962 hybrid_clock.cc:648] HybridClock initialized: now 1786301946318075 us; error 55 us; skew 500 ppm
Aug 09 18:59:06 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:06.321905 12962 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:59:06.322643 12962 webserver.cc:460] Webserver started at http://127.23.229.3:38093/ using document root <none> and password file <none>
I20260809 18:59:06.322957 12962 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:06.323046 12962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:06 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:06.343135 12962 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260809 18:59:06.344400 12990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:06.344660 12962 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:06.344769 12962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "c6b38fe08151425fa889f3594780eaca"
format_stamp: "Formatted at 2026-08-09 18:59:05 on dist-test-slave-jq4t"
server_key: "dd949565d7e4ec95a9af2c97ccceb97d"
server_key_iv: "91f9c6909c5ce594d6242e9795ebb33a"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:06.345357 12962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:06.391983 12962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:06.394744 12962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:06.394940 12962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:06.395219 12962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:06.395679 12962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:06.395733 12962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:06.395767 12962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:06.395787 12962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:06.403645 12962 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:37369
I20260809 18:59:06.403733 13165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:37369 every 8 connection(s)
I20260809 18:59:06.404175 12962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:06.413230 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 12962
Aug 09 18:59:06 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:06.417726 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:06.405076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43809 (local address 127.23.229.3:47787)
0809 18:59:06.406168 (+ 1092us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:06.406222 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:06.406913 (+ 691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:06.407329 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:06.407333 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:06.407580 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:06.407898 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:06.407905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.409061 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.409062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:06.410384 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:06.410388 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.411020 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.411021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:06.411185 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:06.411885 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:06.411896 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:06.414076 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:06.415959 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:06.415967 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:06.415970 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:06.416269 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:06.416532 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:06.416533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:06.416533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:06.416690 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:06.416985 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:06.416991 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:06.417180 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 18:59:06.417298 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 18:59:06.417470 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"thread_start_us":86,"threads_started":1}
I20260809 18:59:06.418218 12754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:06.406012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:47787 (local address 127.23.229.62:43809)
0809 18:59:06.406084 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:06.406086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:06.406322 (+ 236us) server_negotiation.cc:407] Connection header received
0809 18:59:06.407073 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:06.407075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:06.407090 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:06.407123 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:06.408066 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.408907 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.410515 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.410834 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.410889 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:06.414163 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:06.414164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:06.414164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:06.414171 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:06.415869 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:06.416354 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:06.416356 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:06.416356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:06.416428 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:06.416771 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:06.416772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:06.416773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:06.416912 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:06.416992 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:06.418022 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0809 18:59:06.418141 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:59:06.418638 13166 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43809
I20260809 18:59:06.418759 13166 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:06.418984 13166 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
W20260809 18:59:06.419731 13166 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:43809 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:59:06.419793 13166 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:06.419880 13166 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:06.420214 13166 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:06.420296 13166 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
W20260809 18:59:06.420629 13166 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:59:06.422566 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:06.413929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.23.229.62:43809)
0809 18:59:06.414092 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:06.414094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:06.414454 (+ 360us) server_negotiation.cc:407] Connection header received
0809 18:59:06.414475 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:06.414476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:06.414489 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:06.414563 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:06.415310 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.416131 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.417198 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:06.417545 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:06.417611 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:06.419249 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:06.419250 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:06.419251 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:06.419258 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:06.421320 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:06.421757 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:06.421758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:06.421759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:06.421828 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:06.422015 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:06.422016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:06.422016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:06.422174 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:06.422340 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:06.422380 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 18:59:06.422464 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":92,"threads_started":1}
Aug 09 18:59:06 dist-test-slave-jq4t krb5kdc[10944](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:06.985229 12749 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:06.985419 12749 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:06.985874 12445 ts_manager.cc:194] Registered new tserver with Master: 97c55bba9cd04e1c971ad82d1e4f8e3a (127.23.229.1:39137)
I20260809 18:59:06.986989 12445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:55891
I20260809 18:59:07.191051 12954 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:07.191234 12954 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:07.191684 12445 ts_manager.cc:194] Registered new tserver with Master: 916af5cff6d447d0a9119cfa193773e2 (127.23.229.2:36933)
I20260809 18:59:07.192261 12445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:43173
Aug 09 18:59:07 dist-test-slave-jq4t krb5kdc[10944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301946, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for HTTP/127.23.229.20@KRBTEST.COM
I20260809 18:59:07.420831 13166 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:07.421049 13166 heartbeater.cc:511] Master 127.23.229.62:43809 requested a full tablet report, sending...
I20260809 18:59:07.421383 12446 ts_manager.cc:194] Registered new tserver with Master: c6b38fe08151425fa889f3594780eaca (127.23.229.3:37369)
I20260809 18:59:07.421959 12446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:47787
I20260809 18:59:07.432427 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:07.440882 13194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.433582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42952 (local address 127.23.229.62:43809)
0809 18:59:07.433748 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:07.433751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:07.433960 (+ 209us) server_negotiation.cc:407] Connection header received
0809 18:59:07.434035 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:07.434036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:07.434052 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:07.434113 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:07.434838 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.435414 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.436165 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.436391 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.436469 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.437983 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:07.437985 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:07.437985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:07.437993 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:07.439617 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:07.439980 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:07.439981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:07.439982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:07.440053 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:07.440264 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:07.440265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:07.440265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:07.440381 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:07.440506 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:07.440659 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 18:59:07.440746 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260809 18:59:07.443017 12446 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:07.445192 12446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:59:07.454094 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.448146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:36933 (local address 127.0.0.1:44482)
0809 18:59:07.448300 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.448344 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:07.448406 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:07.449158 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:07.449162 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:07.449165 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:07.449244 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.449246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.451772 (+ 2526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.451773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.452839 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.452841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.453789 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.453790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.453872 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.453886 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 18:59:07.453939 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:59:07.453999 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260809 18:59:07.454198 13212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.449113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33440 (local address 127.23.229.1:39137)
0809 18:59:07.449560 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:07.449564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:07.449576 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:59:07.449609 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:07.449611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:07.449627 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:07.449713 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:07.449894 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.450660 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.452587 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.453359 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.453746 (+ 387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.453825 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:07.454062 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 18:59:07.454106 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":64,"threads_started":1}
I20260809 18:59:07.454398 13206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.448415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:39137 (local address 127.0.0.1:33440)
0809 18:59:07.448560 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.448569 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:07.448620 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:07.449711 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:07.449712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:07.449755 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:07.449808 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.449811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.450753 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.450754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.452461 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.452464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.453855 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.453856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.453917 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.453920 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:59:07.453968 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:59:07.454004 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":8,"thread_start_us":100,"threads_started":1}
I20260809 18:59:07.455302 12647 tablet_service.cc:1467] Processing CreateTablet for tablet e224a39c954f48d4b025f6e1e3fa893e (DEFAULT_TABLE table=test-table [id=f0ac3dbc65d04cd2875fafe0fe659021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:07.455739 12647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e224a39c954f48d4b025f6e1e3fa893e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:07.458715 13213 tablet_bootstrap.cc:492] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a: Bootstrap starting.
I20260809 18:59:07.459365 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.448812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44482 (local address 127.23.229.2:36933)
0809 18:59:07.448956 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:07.448962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:07.448973 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:07.449012 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:07.449014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:07.449032 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:07.449327 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:07.449405 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.451672 (+ 2267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.452936 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.453695 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.459102 (+ 5407us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.459189 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:07.459218 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 18:59:07.459270 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260809 18:59:07.460124 13213 tablet_bootstrap.cc:654] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:07.460572 13213 log.cc:824] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:07.461771 12854 tablet_service.cc:1467] Processing CreateTablet for tablet e224a39c954f48d4b025f6e1e3fa893e (DEFAULT_TABLE table=test-table [id=f0ac3dbc65d04cd2875fafe0fe659021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:07.462131 12854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e224a39c954f48d4b025f6e1e3fa893e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:07.463423 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.448633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:37369 (local address 127.0.0.1:54058)
0809 18:59:07.454182 (+ 5549us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.454194 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:07.454243 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:07.459677 (+ 5434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:07.459678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:07.459681 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:07.459730 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.459732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.461122 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.461124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.462195 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.462199 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.463185 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.463187 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.463255 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.463260 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:59:07.463292 (+ 32us) client_negotiation.cc:240] Negotiation successful
0809 18:59:07.463341 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5539,"thread_start_us":85,"threads_started":1}
I20260809 18:59:07.463835 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.448762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54058 (local address 127.23.229.3:37369)
0809 18:59:07.449857 (+ 1095us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:07.449862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:07.458912 (+ 9050us) server_negotiation.cc:407] Connection header received
0809 18:59:07.458962 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:07.458965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:07.458985 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:07.459822 (+ 837us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:07.459928 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.461027 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.462308 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.463067 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.463608 (+ 541us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.463684 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:07.463713 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 18:59:07.463761 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1059,"thread_start_us":55,"threads_started":1}
I20260809 18:59:07.464891 13055 tablet_service.cc:1467] Processing CreateTablet for tablet e224a39c954f48d4b025f6e1e3fa893e (DEFAULT_TABLE table=test-table [id=f0ac3dbc65d04cd2875fafe0fe659021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:07.465248 13055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e224a39c954f48d4b025f6e1e3fa893e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:07.466609 13215 tablet_bootstrap.cc:492] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Bootstrap starting.
I20260809 18:59:07.467388 13215 tablet_bootstrap.cc:654] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:07.467828 13215 log.cc:824] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:07.468776 13215 tablet_bootstrap.cc:492] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: No bootstrap required, opened a new log
I20260809 18:59:07.468868 13215 ts_tablet_manager.cc:1397] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:07.471104 13215 raft_consensus.cc:348] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.471232 13215 raft_consensus.cc:374] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:07.471253 13215 raft_consensus.cc:729] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 916af5cff6d447d0a9119cfa193773e2, State: Initialized, Role: FOLLOWER
I20260809 18:59:07.471390 13215 consensus_queue.cc:260] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.471702 13215 ts_tablet_manager.cc:1428] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:07.471762 12954 heartbeater.cc:503] Master 127.23.229.62:43809 was elected leader, sending a full tablet report...
I20260809 18:59:07.472585 13213 tablet_bootstrap.cc:492] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a: No bootstrap required, opened a new log
I20260809 18:59:07.472664 13213 ts_tablet_manager.cc:1397] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20260809 18:59:07.474797 13213 raft_consensus.cc:348] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.474973 13213 raft_consensus.cc:374] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:07.475028 13213 raft_consensus.cc:729] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c55bba9cd04e1c971ad82d1e4f8e3a, State: Initialized, Role: FOLLOWER
I20260809 18:59:07.475164 13213 consensus_queue.cc:260] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.475662 12749 heartbeater.cc:503] Master 127.23.229.62:43809 was elected leader, sending a full tablet report...
I20260809 18:59:07.475835 13213 ts_tablet_manager.cc:1428] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 18:59:07.476104 13217 tablet_bootstrap.cc:492] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Bootstrap starting.
I20260809 18:59:07.476950 13217 tablet_bootstrap.cc:654] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:07.477285 13217 log.cc:824] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:07.478246 13217 tablet_bootstrap.cc:492] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: No bootstrap required, opened a new log
I20260809 18:59:07.478334 13217 ts_tablet_manager.cc:1397] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:59:07.480202 13217 raft_consensus.cc:348] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.480367 13217 raft_consensus.cc:374] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:07.480434 13217 raft_consensus.cc:729] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6b38fe08151425fa889f3594780eaca, State: Initialized, Role: FOLLOWER
I20260809 18:59:07.480664 13217 consensus_queue.cc:260] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.481069 13166 heartbeater.cc:503] Master 127.23.229.62:43809 was elected leader, sending a full tablet report...
I20260809 18:59:07.481082 13217 ts_tablet_manager.cc:1428] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 18:59:07.494092 13219 raft_consensus.cc:482] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:07.494269 13219 raft_consensus.cc:504] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.494721 13219 leader_election.cc:288] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 916af5cff6d447d0a9119cfa193773e2 (127.23.229.2:36933), c6b38fe08151425fa889f3594780eaca (127.23.229.3:37369)
I20260809 18:59:07.499361 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.495230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:52397 (local address 127.23.229.2:36933)
0809 18:59:07.495283 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:07.495286 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:07.495527 (+ 241us) server_negotiation.cc:407] Connection header received
0809 18:59:07.495621 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:07.495622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:07.495635 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:07.495668 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:07.495923 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.496758 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.498328 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.498896 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.498947 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.498956 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:07.499236 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 18:59:07.499281 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:59:07.499361 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.495333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:48273 (local address 127.23.229.3:37369)
0809 18:59:07.495377 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:07.495379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:07.495624 (+ 245us) server_negotiation.cc:407] Connection header received
0809 18:59:07.495724 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:07.495725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:07.495736 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:07.495765 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:07.495960 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.496694 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.498328 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.498896 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.498947 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.498956 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:07.499236 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 18:59:07.499281 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:59:07.499800 13223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.494901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:37369 (local address 127.23.229.1:48273)
0809 18:59:07.495566 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.495576 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:07.495650 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:07.495830 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:07.495830 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:07.495831 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:07.495883 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.495884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.496800 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.496801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.498211 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.498215 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.499057 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.499058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.499139 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.499146 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 18:59:07.499647 (+ 501us) client_negotiation.cc:240] Negotiation successful
0809 18:59:07.499697 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":96,"thread_start_us":299,"threads_started":1}
I20260809 18:59:07.499938 13222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.494860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:36933 (local address 127.23.229.1:52397)
0809 18:59:07.495429 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.495442 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:07.495518 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:07.495746 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:07.495747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:07.495749 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:07.495838 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.495840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.496848 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.496849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.498211 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:07.498215 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.499057 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.499058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:07.499139 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.499147 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 18:59:07.499796 (+ 649us) client_negotiation.cc:240] Negotiation successful
0809 18:59:07.499840 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":57,"thread_start_us":137,"threads_started":1}
I20260809 18:59:07.500406 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e224a39c954f48d4b025f6e1e3fa893e" candidate_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6b38fe08151425fa889f3594780eaca" is_pre_election: true
I20260809 18:59:07.500463 12887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e224a39c954f48d4b025f6e1e3fa893e" candidate_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "916af5cff6d447d0a9119cfa193773e2" is_pre_election: true
I20260809 18:59:07.500648 13071 raft_consensus.cc:2454] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c55bba9cd04e1c971ad82d1e4f8e3a in term 0.
I20260809 18:59:07.500720 12887 raft_consensus.cc:2454] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c55bba9cd04e1c971ad82d1e4f8e3a in term 0.
I20260809 18:59:07.500952 12575 leader_election.cc:302] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 916af5cff6d447d0a9119cfa193773e2, 97c55bba9cd04e1c971ad82d1e4f8e3a; no voters:
I20260809 18:59:07.501125 13219 raft_consensus.cc:2781] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:07.501188 13219 raft_consensus.cc:482] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:07.501212 13219 raft_consensus.cc:3037] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:07.501976 13219 raft_consensus.cc:504] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.502135 13219 leader_election.cc:288] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [CANDIDATE]: Term 1 election: Requested vote from peers 916af5cff6d447d0a9119cfa193773e2 (127.23.229.2:36933), c6b38fe08151425fa889f3594780eaca (127.23.229.3:37369)
I20260809 18:59:07.502279 12887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e224a39c954f48d4b025f6e1e3fa893e" candidate_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "916af5cff6d447d0a9119cfa193773e2"
I20260809 18:59:07.502333 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e224a39c954f48d4b025f6e1e3fa893e" candidate_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6b38fe08151425fa889f3594780eaca"
I20260809 18:59:07.502367 12887 raft_consensus.cc:3037] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:07.502403 13071 raft_consensus.cc:3037] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:07.503252 12887 raft_consensus.cc:2454] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c55bba9cd04e1c971ad82d1e4f8e3a in term 1.
I20260809 18:59:07.503252 13071 raft_consensus.cc:2454] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c55bba9cd04e1c971ad82d1e4f8e3a in term 1.
I20260809 18:59:07.503451 12575 leader_election.cc:302] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 916af5cff6d447d0a9119cfa193773e2, 97c55bba9cd04e1c971ad82d1e4f8e3a; no voters:
I20260809 18:59:07.503582 13219 raft_consensus.cc:2781] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:07.503798 13219 raft_consensus.cc:686] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [term 1 LEADER]: Becoming Leader. State: Replica: 97c55bba9cd04e1c971ad82d1e4f8e3a, State: Running, Role: LEADER
I20260809 18:59:07.503908 13219 consensus_queue.cc:237] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } }
I20260809 18:59:07.505012 12446 catalog_manager.cc:5495] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c55bba9cd04e1c971ad82d1e4f8e3a (127.23.229.1). New cstate: current_term: 1 leader_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c55bba9cd04e1c971ad82d1e4f8e3a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 } health_report { overall_health: UNKNOWN } } }
I20260809 18:59:07.526839 13212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.523502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33442 (local address 127.23.229.1:39137)
0809 18:59:07.523555 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:07.523557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:07.523567 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:59:07.523618 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:07.523619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:07.523645 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:07.523742 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:07.523899 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.524692 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.525824 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:07.526128 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:07.526220 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:07.526417 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:07.526570 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:07.526663 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:07.526728 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 18:59:07.526754 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:59:07.529234 13071 raft_consensus.cc:1261] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 1 FOLLOWER]: Refusing update from remote peer 97c55bba9cd04e1c971ad82d1e4f8e3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:07.529277 12887 raft_consensus.cc:1261] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 1 FOLLOWER]: Refusing update from remote peer 97c55bba9cd04e1c971ad82d1e4f8e3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:07.529676 13219 consensus_queue.cc:1035] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6b38fe08151425fa889f3594780eaca" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:07.530002 13219 consensus_queue.cc:1035] T e224a39c954f48d4b025f6e1e3fa893e P 97c55bba9cd04e1c971ad82d1e4f8e3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "916af5cff6d447d0a9119cfa193773e2" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:07.535856 13242 mvcc.cc:205] Tried to move back new op lower bound from 7316692777076895744 to 7316692776976752640. Current Snapshot: MvccSnapshot[applied={T|T < 7316692777076895744}]
I20260809 18:59:07.535756 13237 mvcc.cc:205] Tried to move back new op lower bound from 7316692777076895744 to 7316692776976752640. Current Snapshot: MvccSnapshot[applied={T|T < 7316692777076895744}]
I20260809 18:59:07.538908 12446 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:07.539017 12446 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:07.539861 12446 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e029d2b876054579aea285c987cb948d: Sending DeleteTablet for 3 replicas of tablet e224a39c954f48d4b025f6e1e3fa893e
I20260809 18:59:07.540318 13055 tablet_service.cc:1514] Processing DeleteTablet for tablet e224a39c954f48d4b025f6e1e3fa893e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:07 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:54058
I20260809 18:59:07.540735 12647 tablet_service.cc:1514] Processing DeleteTablet for tablet e224a39c954f48d4b025f6e1e3fa893e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:07 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:33440
I20260809 18:59:07.541265 12854 tablet_service.cc:1514] Processing DeleteTablet for tablet e224a39c954f48d4b025f6e1e3fa893e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:07 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:44482
I20260809 18:59:07.542006 13251 tablet_replica.cc:330] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: stopping tablet replica
I20260809 18:59:07.542163 13251 raft_consensus.cc:2229] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:07.542214 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 12504
I20260809 18:59:07.542331 13251 raft_consensus.cc:2258] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:07.542882 13251 ts_tablet_manager.cc:1905] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:07.544811 13251 ts_tablet_manager.cc:1918] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:07.544889 13251 log.cc:1196] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/e224a39c954f48d4b025f6e1e3fa893e
I20260809 18:59:07.545174 13251 ts_tablet_manager.cc:1939] T e224a39c954f48d4b025f6e1e3fa893e P c6b38fe08151425fa889f3594780eaca: Deleting consensus metadata
I20260809 18:59:07.545696 12422 catalog_manager.cc:4841] TS c6b38fe08151425fa889f3594780eaca (127.23.229.3:37369): tablet e224a39c954f48d4b025f6e1e3fa893e (table test-table [id=f0ac3dbc65d04cd2875fafe0fe659021]) successfully deleted
I20260809 18:59:07.548686 13255 tablet_replica.cc:330] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: stopping tablet replica
I20260809 18:59:07.548853 13255 raft_consensus.cc:2229] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:07.548997 13255 raft_consensus.cc:2258] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:07.554739 13255 ts_tablet_manager.cc:1905] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:07.559216 13255 ts_tablet_manager.cc:1918] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:07.559324 13255 log.cc:1196] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/e224a39c954f48d4b025f6e1e3fa893e
I20260809 18:59:07.559641 13255 ts_tablet_manager.cc:1939] T e224a39c954f48d4b025f6e1e3fa893e P 916af5cff6d447d0a9119cfa193773e2: Deleting consensus metadata
I20260809 18:59:07.560209 12425 catalog_manager.cc:4841] TS 916af5cff6d447d0a9119cfa193773e2 (127.23.229.2:36933): tablet e224a39c954f48d4b025f6e1e3fa893e (table test-table [id=f0ac3dbc65d04cd2875fafe0fe659021]) successfully deleted
W20260809 18:59:07.604394 12422 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:39137 (error 108)
I20260809 18:59:07.605069 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.604925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:39137 (local address 127.0.0.1:33456)
0809 18:59:07.604976 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.605017 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:39137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 18:59:07.605219 12422 catalog_manager.cc:4584] TS 97c55bba9cd04e1c971ad82d1e4f8e3a (127.23.229.1:39137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e224a39c954f48d4b025f6e1e3fa893e: Network error: Client connection negotiation failed: client connection to 127.23.229.1:39137: connect: Connection refused (error 111)
I20260809 18:59:07.605425 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 12755
I20260809 18:59:07.638428 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 12962
I20260809 18:59:07.658730 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.658523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:39137 (local address 127.0.0.1:33464)
0809 18:59:07.658617 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.658673 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:39137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 18:59:07.659734 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:07.659638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:39137 (local address 127.0.0.1:33466)
0809 18:59:07.659677 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:07.659702 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:39137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 18:59:07.664324 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 12396
I20260809 18:59:07.678709 24468 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 18:59:08.025331 24468 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 18:59:08.025440 24468 mini_ranger.cc:66] Stopping Ranger...
I20260809 18:59:08.381064 24468 mini_ranger.cc:68] Stopped Ranger
2026-08-09 18:59:08.381 UTC [10989] LOG: received smart shutdown request
2026-08-09 18:59:08.385 UTC [10989] LOG: background worker "logical replication launcher" (PID 10999) exited with exit code 1
2026-08-09 18:59:08.386 UTC [10993] LOG: shutting down
2026-08-09 18:59:08.551 UTC [10989] LOG: database system is shut down
2026-08-09T18:59:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50577 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:08 dist-test-slave-jq4t krb5kdc[13270](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:08 dist-test-slave-jq4t krb5kdc[13270](info): set up 2 sockets
Aug 09 18:59:08 dist-test-slave-jq4t krb5kdc[13270](info): commencing operation
krb5kdc: starting...
W20260809 18:59:09.915995 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:59:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:59:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:59:10.046087 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:35453
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:36195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:35453,127.23.229.61:46211,127.23.229.60:43911
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:10.133401 13302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:10.133654 13302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:10.133692 13302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:10.134838 13302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:10.134910 13302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:10.134936 13302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:10.134959 13302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:10.135001 13302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:10.136649 13302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:36195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:35453,127.23.229.61:46211,127.23.229.60:43911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:35453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:10.136936 13302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:10.137183 13302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:10.142554 13317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:10.142499 13314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:10.142488 13315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:10.142812 13302 server_base.cc:1034] running on GCE node
I20260809 18:59:10.143122 13302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:10.143440 13302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:10.144539 13302 hybrid_clock.cc:648] HybridClock initialized: now 1786301950144515 us; error 39 us; skew 500 ppm
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:10.147243 13302 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:10.147663 13302 webserver.cc:460] Webserver started at http://127.23.229.62:43277/ using document root <none> and password file <none>
I20260809 18:59:10.147884 13302 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:10.147926 13302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:10.148036 13302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:10.149183 13302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "c5c802899c214998bad7226fcd197668"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "2d7f1d92ced3470a50e04fb771644ccb"
server_key_iv: "44f5b61347f7856cfadfb1250df12b35"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.149495 13302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "c5c802899c214998bad7226fcd197668"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "2d7f1d92ced3470a50e04fb771644ccb"
server_key_iv: "44f5b61347f7856cfadfb1250df12b35"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.150826 13302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:59:10.151530 13328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:10.151700 13302 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:59:10.151826 13302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "c5c802899c214998bad7226fcd197668"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "2d7f1d92ced3470a50e04fb771644ccb"
server_key_iv: "44f5b61347f7856cfadfb1250df12b35"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.151904 13302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:10.168304 13302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:10.170789 13302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:10.170977 13302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:10.175318 13302 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:35453
I20260809 18:59:10.175362 13408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:35453 every 8 connection(s)
I20260809 18:59:10.175742 13302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:10.176674 13409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:10.178354 13409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.182407 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 13302
I20260809 18:59:10.182535 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:59:10.182747 24468 external_mini_cluster.cc:1428] Setting key 075537b8e4f96d207aca659d5b4e66e1
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:10.188417 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.179049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:35453 (local address 127.0.0.1:40062)
0809 18:59:10.179196 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.179231 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.179687 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.179944 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.179946 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.180191 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.180375 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.180379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.181465 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.181466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.182208 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.182211 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.182782 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.182783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.182878 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.183398 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.183409 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.185034 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.186820 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.186827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.186830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.187036 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.187287 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.187287 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.187288 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.187377 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.187761 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.187767 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.187835 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.187947 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.188210 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":100,"thread_start_us":62,"threads_started":1}
I20260809 18:59:10.188417 13413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.179197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40062 (local address 127.23.229.62:35453)
0809 18:59:10.179336 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.179340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.179369 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:59:10.179816 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.179818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.179834 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.179910 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.180458 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.181373 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.182297 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.182697 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.182775 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.185138 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.185145 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.185146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.185159 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.186713 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.187120 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.187124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.187124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.187210 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.187449 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.187450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.187450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.187681 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.187771 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.187990 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.188138 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260809 18:59:10.189306 13409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.189730 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.189608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59298)
0809 18:59:10.189658 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.189705 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:59:10.189926 13334 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
I20260809 18:59:10.190395 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.190303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59308)
0809 18:59:10.190351 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.190376 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 18:59:10.190588 13409 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:46211: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.23.229.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab.
Entry for principal kudu/127.23.229.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab.
I20260809 18:59:10.209597 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:46211
--webserver_interface=127.23.229.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab
--principal=kudu/127.23.229.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:36195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:35453,127.23.229.61:46211,127.23.229.60:43911
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:10.239825 13409 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } attempt: 1
I20260809 18:59:10.240371 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.240229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59310)
0809 18:59:10.240294 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.240338 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 18:59:10.240849 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.240752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59314)
0809 18:59:10.240799 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.240828 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:59:10.240973 13409 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:46211: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
W20260809 18:59:10.295526 13421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:10.295778 13421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:10.295818 13421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:10.296990 13421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:10.297065 13421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:10.297086 13421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:10.297108 13421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:10.297138 13421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:10.298715 13421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:36195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:35453,127.23.229.61:46211,127.23.229.60:43911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab
--principal=kudu/127.23.229.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:46211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.229.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:10.299003 13421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:10.299237 13421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:10.304919 13432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:10.304960 13428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:10.304975 13427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:10.305255 13421 server_base.cc:1034] running on GCE node
I20260809 18:59:10.305557 13421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:10.305855 13421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:10.307040 13421 hybrid_clock.cc:648] HybridClock initialized: now 1786301950307028 us; error 37 us; skew 500 ppm
I20260809 18:59:10.309120 13409 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } attempt: 2
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:10.309623 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.309458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59320)
0809 18:59:10.309538 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.309567 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 18:59:10.310036 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.309922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59324)
0809 18:59:10.309979 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.310011 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 18:59:10.310030 13421 init.cc:377] Logged in from keytab as kudu/127.23.229.61@KRBTEST.COM (short username kudu)
W20260809 18:59:10.310181 13409 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:46211: Network error: Client connection negotiation failed: client connection to 127.23.229.61:46211: connect: Connection refused (error 111)
I20260809 18:59:10.310549 13421 webserver.cc:460] Webserver started at http://127.23.229.61:36247/ using document root <none> and password file <none>
I20260809 18:59:10.310844 13421 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:10.310930 13421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:10.311077 13421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:10.312181 13421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data/instance:
uuid: "2a0f9038dda64fe98f7ddae95f0cf43a"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "ebf807724d5ad404bfba81273bf1a8e9"
server_key_iv: "9261f94023286be16495be2e3e744ee3"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.312620 13421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/wal/instance:
uuid: "2a0f9038dda64fe98f7ddae95f0cf43a"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "ebf807724d5ad404bfba81273bf1a8e9"
server_key_iv: "9261f94023286be16495be2e3e744ee3"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.314046 13421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:10.314919 13442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:10.315233 13421 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:10.315338 13421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/wal
uuid: "2a0f9038dda64fe98f7ddae95f0cf43a"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "ebf807724d5ad404bfba81273bf1a8e9"
server_key_iv: "9261f94023286be16495be2e3e744ee3"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.315433 13421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:10.332326 13421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:10.334447 13421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:10.334617 13421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:10.339008 13421 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.61:46211
I20260809 18:59:10.339042 13521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.61:46211 every 8 connection(s)
I20260809 18:59:10.339453 13421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
I20260809 18:59:10.340363 13522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:10.342135 13522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.345455 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 13421
I20260809 18:59:10.345578 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-1/wal/instance
I20260809 18:59:10.345759 24468 external_mini_cluster.cc:1428] Setting key c1d22d586770fe2e9590ab0d11db82c3
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:10.352806 13413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.342848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40078 (local address 127.23.229.62:35453)
0809 18:59:10.342910 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.342912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.343133 (+ 221us) server_negotiation.cc:407] Connection header received
0809 18:59:10.343606 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.343607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.343619 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.343681 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.344317 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.344892 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.346328 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.346544 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.346598 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.349192 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.349194 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.349195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.349205 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.351102 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.351567 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.351569 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.351569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.351640 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.351959 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.351960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.351961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.352139 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.352222 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.352552 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.352658 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:59:10.352839 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.342810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:35453 (local address 127.0.0.1:40078)
0809 18:59:10.343000 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.343043 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.343519 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.343749 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.343752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.344030 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.344238 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.344243 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.344975 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.344976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.346225 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.346229 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.346632 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.346633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.346796 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.347356 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.347368 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.349081 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.351206 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.351214 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.351217 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.351479 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.351743 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.351744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.351744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.351880 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.352215 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.352221 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.352354 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.352443 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.352663 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260809 18:59:10.353799 13522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.23.229.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.60@KRBTEST.COM" created.
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 18:59:10.362157 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.354086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59336)
0809 18:59:10.354139 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.354150 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.354189 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.354541 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.354542 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.354724 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.354796 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.354798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.355763 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.355765 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.356366 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.356368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.356946 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.356947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.357010 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.357384 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.357388 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.359156 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.361030 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.361031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.361032 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.361272 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.361481 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.361483 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.361483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.361565 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.361905 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.361906 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.361946 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.362002 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.362088 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 18:59:10.362319 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.354190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.23.229.61:46211)
0809 18:59:10.354395 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.354398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.354416 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:59:10.354434 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.354435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.354446 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.354505 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.354881 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.355690 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.356493 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.356871 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.356937 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.359242 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.359252 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.359252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.359260 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.360944 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.361359 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.361361 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.361362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.361412 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.361630 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.361630 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.361631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.361832 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.361917 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.362036 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.362162 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":177,"thread_start_us":104,"threads_started":1}
I20260809 18:59:10.363123 13522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.363507 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.363381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34878)
0809 18:59:10.363434 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.363488 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 18:59:10.363637 13446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
I20260809 18:59:10.364073 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.363975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34884)
0809 18:59:10.364021 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.364046 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:59:10.364176 13522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:43911: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab.
Entry for principal kudu/127.23.229.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab.
I20260809 18:59:10.375885 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:43911
--webserver_interface=127.23.229.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab
--principal=kudu/127.23.229.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:36195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:35453,127.23.229.61:46211,127.23.229.60:43911
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:10.401346 13409 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } attempt: 3
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 18:59:10.408879 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.401749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59340)
0809 18:59:10.401827 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.401841 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.401924 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.402093 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.402093 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.402273 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.402352 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.402354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.403095 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.403097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.403648 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.403649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.404085 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.404086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.404183 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.404763 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.404768 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.406023 (+ 1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.407747 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.407748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.407749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.407930 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.408163 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.408164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.408164 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.408228 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.408510 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.408517 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.408568 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.408661 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.408772 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 18:59:10.408879 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.401842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59340 (local address 127.23.229.61:46211)
0809 18:59:10.401924 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.401926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.401938 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:59:10.401992 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.401993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.402009 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.402081 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.402450 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.402998 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.403743 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.403999 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.404085 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.406122 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.406124 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.406124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.406133 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.407626 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.408029 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.408030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.408030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.408090 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.408308 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.408309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.408309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.408430 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.408540 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.408689 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.408773 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:59:10.409330 13409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.409698 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.409593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34900)
0809 18:59:10.409643 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.409671 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:59:10.410075 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.410014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34902)
0809 18:59:10.410040 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.410062 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260809 18:59:10.410175 13409 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:43911: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
I20260809 18:59:10.413388 13522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } attempt: 1
I20260809 18:59:10.413769 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.413656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34914)
0809 18:59:10.413711 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.413745 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 18:59:10.414155 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.414071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34922)
0809 18:59:10.414116 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.414140 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 18:59:10.414261 13522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:43911: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
I20260809 18:59:10.441334 13409 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } attempt: 1
I20260809 18:59:10.441921 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.441765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34926)
0809 18:59:10.441839 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.441887 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 18:59:10.442318 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.442223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34942)
0809 18:59:10.442266 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.442292 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:59:10.442438 13409 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:43911: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
W20260809 18:59:10.464167 13537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:10.464416 13537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:10.464442 13537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:10.465656 13537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:10.465701 13537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:10.465716 13537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:10.465728 13537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:10.465775 13537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:10.467319 13537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:36195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:35453,127.23.229.61:46211,127.23.229.60:43911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab
--principal=kudu/127.23.229.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:43911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.229.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:10.467602 13537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:10.467859 13537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:10.473228 13546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:10.473203 13550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:10.473191 13548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:10.473225 13537 server_base.cc:1034] running on GCE node
I20260809 18:59:10.473845 13537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:10.474184 13537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:10.475353 13537 hybrid_clock.cc:648] HybridClock initialized: now 1786301950475342 us; error 45 us; skew 500 ppm
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:10.478044 13537 init.cc:377] Logged in from keytab as kudu/127.23.229.60@KRBTEST.COM (short username kudu)
I20260809 18:59:10.478552 13537 webserver.cc:460] Webserver started at http://127.23.229.60:36989/ using document root <none> and password file <none>
I20260809 18:59:10.478794 13537 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:10.478864 13537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:10.479025 13537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:10.480147 13537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data/instance:
uuid: "0e6dbbfd811a44b5b0e105ae29655a24"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "87a9912b4d5666424de7a33df8f48ea2"
server_key_iv: "078d105a7b53343e53cbde10079a6045"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.480613 13537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/wal/instance:
uuid: "0e6dbbfd811a44b5b0e105ae29655a24"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "87a9912b4d5666424de7a33df8f48ea2"
server_key_iv: "078d105a7b53343e53cbde10079a6045"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.482025 13537 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:10.482399 13522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } attempt: 2
I20260809 18:59:10.482856 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.482704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34946)
0809 18:59:10.482775 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.482816 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 18:59:10.482867 13562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:10.483029 13537 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:10.483121 13537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/wal
uuid: "0e6dbbfd811a44b5b0e105ae29655a24"
format_stamp: "Formatted at 2026-08-09 18:59:10 on dist-test-slave-jq4t"
server_key: "87a9912b4d5666424de7a33df8f48ea2"
server_key_iv: "078d105a7b53343e53cbde10079a6045"
server_key_version: "encryptionkey@0"
I20260809 18:59:10.483215 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.483137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34956)
0809 18:59:10.483167 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.483191 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 18:59:10.483213 13537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260809 18:59:10.483342 13522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:43911: Network error: Client connection negotiation failed: client connection to 127.23.229.60:43911: connect: Connection refused (error 111)
I20260809 18:59:10.502067 13537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:10.504060 13537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:10.504237 13537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:10.508692 13537 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.60:43911
I20260809 18:59:10.508728 13646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.60:43911 every 8 connection(s)
I20260809 18:59:10.509131 13537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
I20260809 18:59:10.510080 13647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:10.511721 13647 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.512158 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 13537
I20260809 18:59:10.512274 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301787754163-24468-0/minicluster-data/master-2/wal/instance
I20260809 18:59:10.512501 24468 external_mini_cluster.cc:1428] Setting key ad83bb01677c4c6867cd8917d2dea488
I20260809 18:59:10.517612 13409 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } attempt: 2
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 18:59:10.523046 13413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.512556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40090 (local address 127.23.229.62:35453)
0809 18:59:10.512665 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.512669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.512875 (+ 206us) server_negotiation.cc:407] Connection header received
0809 18:59:10.513571 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.513573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.513587 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.513652 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.514216 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.514714 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.515775 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.516103 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.516171 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.519411 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.519413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.519413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.519421 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.521231 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.521815 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.521817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.521817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.521878 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.522142 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.522143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.522143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.522287 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.522354 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.522871 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.522951 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:59:10.523193 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.512532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:35453 (local address 127.0.0.1:40090)
0809 18:59:10.512738 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.512775 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.513434 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.513687 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.513690 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.513953 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.514117 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.514121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.514794 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.514795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.515691 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.515693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.516184 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.516185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.516329 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.516977 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.516985 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.519329 (+ 2344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.521331 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.521338 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.521341 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.521727 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.521940 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.521940 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.521941 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.522068 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.522381 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.522389 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.522575 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.522687 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.522933 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":99,"threads_started":1}
I20260809 18:59:10.523835 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.512904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34966 (local address 127.23.229.60:43911)
0809 18:59:10.513074 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.513079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.513109 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:59:10.513435 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.513448 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.513477 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.513576 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.514223 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.515269 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.516167 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.516627 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.516683 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.519350 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.519360 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.519361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.519373 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.521795 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.522224 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.522227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.522227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.522276 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.522513 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.522515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.522515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.522655 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.522830 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.523365 (+ 535us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.523492 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":80,"threads_started":1}
I20260809 18:59:10.524000 13647 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.525939 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.517927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34974)
0809 18:59:10.517981 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.517991 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.518054 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.518340 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.518342 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.518524 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.518563 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.518564 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.519519 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.519520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.520277 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.520279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.520843 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.520844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.520914 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.521312 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.521316 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.522618 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.524765 (+ 2147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.524766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.524767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.525017 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.525233 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.525234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.525234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.525304 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.525616 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.525616 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.525660 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.525732 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.525822 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 18:59:10.525971 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.517957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34974 (local address 127.23.229.60:43911)
0809 18:59:10.518193 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.518195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.518202 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:59:10.518221 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.518221 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.518230 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.518302 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.518647 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.519418 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.520411 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.520760 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.520839 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.522730 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.522732 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.522732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.522739 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.524666 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.525100 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.525101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.525102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.525162 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.525381 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.525382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.525383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.525539 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.525613 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.525760 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.525835 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":110,"threads_started":1}
I20260809 18:59:10.527935 13409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: Bootstrap starting.
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 18:59:10.528808 13409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:10.529150 13409 log.cc:824] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:10.529956 13409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: No bootstrap required, opened a new log
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:10.532043 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.524698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59350 (local address 127.23.229.61:46211)
0809 18:59:10.524745 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.524747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.524755 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:59:10.524780 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.524781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.524791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.524852 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.525176 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.525858 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.526772 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.526990 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.527067 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.528988 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.528990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.528990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.528999 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.530792 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.531193 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.531194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.531194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.531256 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.531466 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.531467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.531468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.531633 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.531706 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.531908 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.531982 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:59:10.532044 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.524588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:46211 (local address 127.0.0.1:59350)
0809 18:59:10.524623 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.524636 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.524675 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.524859 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.524860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.525046 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.525089 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.525091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.525945 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.525947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.526680 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.526683 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.527063 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.527064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.527125 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.527560 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.527565 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.528896 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.530882 (+ 1986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.530883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.530884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.531107 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.531317 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.531318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.531318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.531377 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.531714 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.531715 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.531766 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.531857 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.531949 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260809 18:59:10.532091 13409 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.532403 13409 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:10.532465 13409 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c802899c214998bad7226fcd197668, State: Initialized, Role: FOLLOWER
I20260809 18:59:10.532444 13647 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:10.532657 13409 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.533138 13409 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:10.534204 13413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.524823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40092 (local address 127.23.229.62:35453)
0809 18:59:10.524867 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.524869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.524979 (+ 110us) server_negotiation.cc:407] Connection header received
0809 18:59:10.525024 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.525025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.525035 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.525094 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.525675 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.526344 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.527235 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.527490 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.527553 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.530724 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.530726 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.530726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.530733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.533035 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.533397 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.533398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.533399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.533455 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.533675 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.533676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.533677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.533829 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.533986 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.534036 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.534118 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260809 18:59:10.535239 13671 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:59:10.535321 13671 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:59:10.535457 13654 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.535547 13654 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 18:59:10.536113 13302 master_runner.cc:186] Error getting master registration for 127.23.229.61:46211: OK, instance_id { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" instance_seqno: 1786301950337825 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:59:10.538952 13302 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 18:59:10.541105 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.532782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34986 (local address 127.23.229.60:43911)
0809 18:59:10.532815 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.532817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.532846 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:59:10.532915 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.532916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.532923 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.532993 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.533260 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.533992 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.534894 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.535231 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.536271 (+ 1040us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.537498 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.537499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.537500 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.537506 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.539643 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.540022 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.540023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.540024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.540075 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.540271 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.540271 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.540272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.540397 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.540519 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.540931 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.541007 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:59:10.541111 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.532756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34986)
0809 18:59:10.532794 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.532805 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.532861 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.532997 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.532998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.533146 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.533184 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.533185 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.534073 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.534074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.534792 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.534794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.535309 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.535310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.535358 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.535777 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.535782 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.537420 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.539739 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.539740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.539740 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.539933 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.540149 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.540150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.540150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.540207 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.540511 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.540512 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.540552 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.540647 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.540740 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260809 18:59:10.542923 13647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: Bootstrap starting.
I20260809 18:59:10.543803 13647 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:10.544157 13647 log.cc:824] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:10.544589 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.535092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59352 (local address 127.23.229.61:46211)
0809 18:59:10.535126 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.535128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.535134 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:59:10.535152 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.535153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.535161 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.535204 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.535866 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.536554 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.537506 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.537804 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.537872 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.540655 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.540657 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.540657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.540663 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.542342 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.542741 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.542743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.542743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.542806 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.543050 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.543052 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.543052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.543182 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.543915 (+ 733us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.544376 (+ 461us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.544463 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:59:10.545414 13647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: No bootstrap required, opened a new log
I20260809 18:59:10.546337 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:59:10.547394 13647 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.547575 13647 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:10.547674 13647 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e6dbbfd811a44b5b0e105ae29655a24, State: Initialized, Role: FOLLOWER
I20260809 18:59:10.547857 13647 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.548286 13647 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:10.548308 13685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.548441 13685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:59:10.551800 13706 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:59:10.551887 13706 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:59:10.552039 13537 master_runner.cc:186] Error getting master registration for 127.23.229.61:46211: OK, instance_id { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" instance_seqno: 1786301950337825 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:59:10.554328 13537 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:59:10.556329 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.547946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34990 (local address 127.23.229.60:43911)
0809 18:59:10.547984 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.547986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.548308 (+ 322us) server_negotiation.cc:407] Connection header received
0809 18:59:10.548404 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.548405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.548415 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.548444 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.549231 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.549942 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.550982 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.551279 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.551339 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.553008 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.553009 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.553010 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.553017 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.554762 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.555175 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.555177 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.555177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.555232 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.555427 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.555428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.555428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.555554 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.555656 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.556163 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.556241 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:59:10.563668 13413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.547982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40102 (local address 127.23.229.62:35453)
0809 18:59:10.548026 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.548027 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.556047 (+ 8020us) server_negotiation.cc:407] Connection header received
0809 18:59:10.556131 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.556133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.556146 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.556199 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.556898 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.557619 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.558604 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.558899 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.558982 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.560424 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.560426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.560426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.560434 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.562260 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.562648 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.562649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.562649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.562706 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.562900 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.562900 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.562901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.563040 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.563144 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.563498 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.563576 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:59:10.567932 13531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.560751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59354 (local address 127.23.229.61:46211)
0809 18:59:10.560796 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.560798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.560807 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:59:10.560862 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.560864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.560877 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.560907 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.561509 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.562240 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.563261 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.563572 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.563612 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.565061 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.565063 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.565063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.565070 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.566712 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.567100 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.567102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.567102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.567162 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.567372 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.567373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.567373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.567505 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.567604 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.567752 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.567836 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:59:10.574487 13522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } attempt: 3
Aug 09 18:59:10 dist-test-slave-jq4t krb5kdc[13270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 18:59:10.582857 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.574862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.23.229.60:43911)
0809 18:59:10.574902 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:10.574903 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:10.574911 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:59:10.574933 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:10.574934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:10.574943 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:10.575013 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:10.575333 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.576081 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.577112 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.577417 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.577495 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.579868 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:10.579869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:10.579870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:10.579877 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:10.581621 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.582016 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.582017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.582017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.582082 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:10.582292 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:10.582293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:10.582293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:10.582437 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:10.582510 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:10.582685 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 18:59:10.582764 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:59:10.582930 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:10.574754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:43911 (local address 127.0.0.1:34992)
0809 18:59:10.574802 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:10.574812 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:10.574856 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:10.575032 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:10.575033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:10.575207 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:10.575254 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.575256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.576171 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.576172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.577025 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:10.577027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:10.577497 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:10.577498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:10.577567 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:10.578059 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:10.578065 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:10.579783 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:10.581711 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.581713 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.581713 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.581937 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.582157 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:10.582158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:10.582158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:10.582224 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:10.582519 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:10.582520 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:10.582569 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:59:10.582644 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 18:59:10.582743 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 18:59:10.585088 13522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a: Bootstrap starting.
I20260809 18:59:10.585924 13522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:10.586254 13522 log.cc:824] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:10.587572 13522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a: No bootstrap required, opened a new log
I20260809 18:59:10.589731 13522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.589891 13522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:10.589926 13522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0f9038dda64fe98f7ddae95f0cf43a, State: Initialized, Role: FOLLOWER
I20260809 18:59:10.590102 13522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.590487 13522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:10.590442 13712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.590633 13712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:59:10.592459 13725 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:59:10.592615 13725 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:59:10.594794 13421 master_runner.cc:263] No leader master found from master 2a0f9038dda64fe98f7ddae95f0cf43a
I20260809 18:59:10.594854 13421 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:59:10.599942 13712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:10.600040 13712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.600281 13712 leader_election.cc:288] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5c802899c214998bad7226fcd197668 (127.23.229.62:35453), 0e6dbbfd811a44b5b0e105ae29655a24 (127.23.229.60:43911)
I20260809 18:59:10.600715 13365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c802899c214998bad7226fcd197668" is_pre_election: true
I20260809 18:59:10.600874 13365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a0f9038dda64fe98f7ddae95f0cf43a in term 0.
I20260809 18:59:10.601711 13448 leader_election.cc:302] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0f9038dda64fe98f7ddae95f0cf43a, c5c802899c214998bad7226fcd197668; no voters:
I20260809 18:59:10.602064 13606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" is_pre_election: true
I20260809 18:59:10.602221 13606 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a0f9038dda64fe98f7ddae95f0cf43a in term 0.
I20260809 18:59:10.602654 13712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:10.602727 13712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:10.602757 13712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:10.603726 13712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.603853 13712 leader_election.cc:288] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [CANDIDATE]: Term 1 election: Requested vote from peers c5c802899c214998bad7226fcd197668 (127.23.229.62:35453), 0e6dbbfd811a44b5b0e105ae29655a24 (127.23.229.60:43911)
I20260809 18:59:10.604123 13365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c802899c214998bad7226fcd197668"
I20260809 18:59:10.604207 13365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:10.604549 13606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6dbbfd811a44b5b0e105ae29655a24"
I20260809 18:59:10.604627 13606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:10.605504 13606 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a0f9038dda64fe98f7ddae95f0cf43a in term 1.
I20260809 18:59:10.605676 13446 leader_election.cc:302] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e6dbbfd811a44b5b0e105ae29655a24, 2a0f9038dda64fe98f7ddae95f0cf43a; no voters:
I20260809 18:59:10.606336 13365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a0f9038dda64fe98f7ddae95f0cf43a in term 1.
I20260809 18:59:10.606537 13712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:10.606714 13712 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [term 1 LEADER]: Becoming Leader. State: Replica: 2a0f9038dda64fe98f7ddae95f0cf43a, State: Running, Role: LEADER
I20260809 18:59:10.606808 13712 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } }
I20260809 18:59:10.607179 13712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a0f9038dda64fe98f7ddae95f0cf43a. Latest consensus state: current_term: 1 leader_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.607254 13712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:10.607463 13730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:10.607664 13730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:10.609714 13606 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [term 1 FOLLOWER]: Refusing update from remote peer 2a0f9038dda64fe98f7ddae95f0cf43a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:10.610823 13712 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:10.612819 13685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a0f9038dda64fe98f7ddae95f0cf43a. Latest consensus state: current_term: 1 leader_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.612915 13685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:10.613327 13365 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [term 1 FOLLOWER]: Refusing update from remote peer 2a0f9038dda64fe98f7ddae95f0cf43a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:10.613585 13712 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:10.614756 13654 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a0f9038dda64fe98f7ddae95f0cf43a. Latest consensus state: current_term: 1 leader_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.614850 13654 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:10.616182 13731 mvcc.cc:205] Tried to move back new op lower bound from 7316692789695041536 to 7316692789686063104. Current Snapshot: MvccSnapshot[applied={T|T < 7316692789695041536}]
I20260809 18:59:10.616519 13712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.616602 13712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:10.617053 13654 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.617137 13654 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:10.617422 13737 mvcc.cc:205] Tried to move back new op lower bound from 7316692789695041536 to 7316692789686063104. Current Snapshot: MvccSnapshot[applied={T|T < 7316692789695041536}]
I20260809 18:59:10.618444 13712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.618534 13712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:10.618925 13685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c802899c214998bad7226fcd197668" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35453 } } peers { permanent_uuid: "2a0f9038dda64fe98f7ddae95f0cf43a" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 46211 } } peers { permanent_uuid: "0e6dbbfd811a44b5b0e105ae29655a24" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 43911 } } }
I20260809 18:59:10.619022 13685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:10.619788 13733 mvcc.cc:205] Tried to move back new op lower bound from 7316692789695041536 to 7316692789686063104. Current Snapshot: MvccSnapshot[applied={T|T < 7316692789695041536}]
I20260809 18:59:10.621485 13730 catalog_manager.cc:1347] Generated new cluster ID: 6a2476c1fe984a729ef133503d7c32ac
I20260809 18:59:10.621546 13730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:10.629524 13730 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:10.630302 13730 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:10.642903 13730 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a0f9038dda64fe98f7ddae95f0cf43a: Generated new TSK 0
I20260809 18:59:10.643160 13730 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:59:11.535828 13671 catalog_manager.cc:1259] Loaded cluster ID: 6a2476c1fe984a729ef133503d7c32ac
I20260809 18:59:11.535928 13671 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: loading cluster ID for follower catalog manager: success
I20260809 18:59:11.536743 13671 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: acquiring CA information for follower catalog manager: success
I20260809 18:59:11.537002 13671 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c5c802899c214998bad7226fcd197668: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:59:11.552402 13706 catalog_manager.cc:1259] Loaded cluster ID: 6a2476c1fe984a729ef133503d7c32ac
I20260809 18:59:11.552520 13706 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: loading cluster ID for follower catalog manager: success
I20260809 18:59:11.553316 13706 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: acquiring CA information for follower catalog manager: success
I20260809 18:59:11.553587 13706 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0e6dbbfd811a44b5b0e105ae29655a24: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:59:11.700148 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 13302
I20260809 18:59:11.713306 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 13421
I20260809 18:59:11.728353 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 13537
2026-08-09T18:59:11Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3063 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:11 dist-test-slave-jq4t krb5kdc[13758](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:11 dist-test-slave-jq4t krb5kdc[13758](info): set up 2 sockets
Aug 09 18:59:11 dist-test-slave-jq4t krb5kdc[13758](info): commencing operation
krb5kdc: starting...
W20260809 18:59:12.974599 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:59:13 dist-test-slave-jq4t krb5kdc[13758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:59:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:59:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:59:13.103184 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:37935
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:45375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:37935
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:13.187915 13779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:13.188149 13779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:13.188174 13779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:13.189318 13779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:13.189371 13779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:13.189385 13779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:13.189399 13779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:13.189410 13779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:13.191009 13779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:45375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:37935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:37935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:13.191256 13779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:13.191461 13779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:13.196895 13795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:13.196899 13791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:13.196957 13779 server_base.cc:1034] running on GCE node
W20260809 18:59:13.196879 13788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:13.197423 13779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:13.197804 13779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:13.198957 13779 hybrid_clock.cc:648] HybridClock initialized: now 1786301953198943 us; error 30 us; skew 500 ppm
Aug 09 18:59:13 dist-test-slave-jq4t krb5kdc[13758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301953, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:13.201679 13779 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:13.202178 13779 webserver.cc:460] Webserver started at http://127.23.229.62:44403/ using document root <none> and password file <none>
I20260809 18:59:13.202412 13779 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:13.202487 13779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:13.202646 13779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:13.203778 13779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "3ad911f4db1541e793eea6b392c51d22"
format_stamp: "Formatted at 2026-08-09 18:59:13 on dist-test-slave-jq4t"
server_key: "0f2edc67c50b4914cad43ed66da26e15"
server_key_iv: "67eafad120bec6ca4c0c22e6d89173b5"
server_key_version: "encryptionkey@0"
I20260809 18:59:13.204211 13779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "3ad911f4db1541e793eea6b392c51d22"
format_stamp: "Formatted at 2026-08-09 18:59:13 on dist-test-slave-jq4t"
server_key: "0f2edc67c50b4914cad43ed66da26e15"
server_key_iv: "67eafad120bec6ca4c0c22e6d89173b5"
server_key_version: "encryptionkey@0"
I20260809 18:59:13.205735 13779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:59:13.206645 13806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:13.206863 13779 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:13.206974 13779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "3ad911f4db1541e793eea6b392c51d22"
format_stamp: "Formatted at 2026-08-09 18:59:13 on dist-test-slave-jq4t"
server_key: "0f2edc67c50b4914cad43ed66da26e15"
server_key_iv: "67eafad120bec6ca4c0c22e6d89173b5"
server_key_version: "encryptionkey@0"
I20260809 18:59:13.207069 13779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:13.216755 13779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:13.219167 13779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:13.219338 13779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:13.223762 13779 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:37935
I20260809 18:59:13.223799 13883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:37935 every 8 connection(s)
I20260809 18:59:13.224170 13779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:13.225169 13884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:13.227545 13884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22: Bootstrap starting.
I20260809 18:59:13.228209 13884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:13.228578 13884 log.cc:824] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:13.228742 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 13779
I20260809 18:59:13.228856 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:59:13.229072 24468 external_mini_cluster.cc:1428] Setting key 2504f64def21633ee0fe14fc4788443f
I20260809 18:59:13.229570 13884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22: No bootstrap required, opened a new log
I20260809 18:59:13.231413 13884 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad911f4db1541e793eea6b392c51d22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37935 } }
I20260809 18:59:13.231591 13884 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:13.231660 13884 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad911f4db1541e793eea6b392c51d22, State: Initialized, Role: FOLLOWER
I20260809 18:59:13.231827 13884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad911f4db1541e793eea6b392c51d22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37935 } }
I20260809 18:59:13.231916 13884 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:13.231947 13884 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:13.232007 13884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:13.233002 13884 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad911f4db1541e793eea6b392c51d22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37935 } }
I20260809 18:59:13.233129 13884 leader_election.cc:302] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ad911f4db1541e793eea6b392c51d22; no voters:
I20260809 18:59:13.233318 13884 leader_election.cc:288] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:59:13.233371 13890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:13.233525 13890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [term 1 LEADER]: Becoming Leader. State: Replica: 3ad911f4db1541e793eea6b392c51d22, State: Running, Role: LEADER
I20260809 18:59:13.233625 13884 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:13.233690 13890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad911f4db1541e793eea6b392c51d22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37935 } }
I20260809 18:59:13.234076 13890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ad911f4db1541e793eea6b392c51d22. Latest consensus state: current_term: 1 leader_uuid: "3ad911f4db1541e793eea6b392c51d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad911f4db1541e793eea6b392c51d22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37935 } } }
I20260809 18:59:13.234229 13894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ad911f4db1541e793eea6b392c51d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad911f4db1541e793eea6b392c51d22" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 37935 } } }
I20260809 18:59:13.234290 13894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:13.234216 13890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:13.234648 13905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:13.235477 13905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:13.237341 13905 catalog_manager.cc:1347] Generated new cluster ID: 30a3fd71012a4480a16d25a8560b4ea3
I20260809 18:59:13.237401 13905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:59:13 dist-test-slave-jq4t krb5kdc[13758](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:13.242573 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:13.229648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57030 (local address 127.23.229.62:37935)
0809 18:59:13.229852 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:13.229860 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:13.229887 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:59:13.231403 (+ 1516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:13.231420 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:13.231480 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:13.231661 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:13.232531 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:13.233728 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:13.234864 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:13.235484 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:13.235930 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:13.238564 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:13.238568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:13.238568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:13.238581 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:13.240655 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:13.241051 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:13.241055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:13.241056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:13.241203 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:13.241412 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:13.241413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:13.241413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:13.241740 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:13.241913 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:13.242010 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 18:59:13.242153 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
I20260809 18:59:13.243644 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:59:13.282932 13905 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:13.283571 13905 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:13.292174 13905 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ad911f4db1541e793eea6b392c51d22: Generated new TSK 0
I20260809 18:59:13.292407 13905 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:59:13.297837 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 13779
2026-08-09T18:59:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1577 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:13 dist-test-slave-jq4t krb5kdc[13933](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:13 dist-test-slave-jq4t krb5kdc[13933](info): set up 2 sockets
Aug 09 18:59:13 dist-test-slave-jq4t krb5kdc[13933](info): commencing operation
krb5kdc: starting...
W20260809 18:59:14.554397 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:59:14 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:59:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:59:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:59:14.682909 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43959
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:14.769507 13952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:14.769745 13952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:14.769768 13952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:14.770912 13952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:14.770953 13952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:14.770968 13952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:14.770982 13952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:14.770993 13952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:14.772532 13952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:14.772769 13952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:14.772966 13952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:14.778319 13960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:14.778319 13962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:14.778321 13957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:14.778614 13952 server_base.cc:1034] running on GCE node
I20260809 18:59:14.778872 13952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:14.779199 13952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:14.780344 13952 hybrid_clock.cc:648] HybridClock initialized: now 1786301954780321 us; error 36 us; skew 500 ppm
Aug 09 18:59:14 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301954, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:14.786546 13952 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:14.787140 13952 webserver.cc:460] Webserver started at http://127.23.229.62:45681/ using document root <none> and password file <none>
I20260809 18:59:14.787407 13952 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:14.787460 13952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:14.787627 13952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:14.788970 13952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "bace1d74aa95caf31fdbdb10449b55ff"
server_key_iv: "04730e2195ca1ea252151d8dbabb751e"
server_key_version: "encryptionkey@0"
I20260809 18:59:14.789371 13952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "bace1d74aa95caf31fdbdb10449b55ff"
server_key_iv: "04730e2195ca1ea252151d8dbabb751e"
server_key_version: "encryptionkey@0"
I20260809 18:59:14.791100 13952 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:14.792126 13971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:14.792385 13952 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:14.792546 13952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "bace1d74aa95caf31fdbdb10449b55ff"
server_key_iv: "04730e2195ca1ea252151d8dbabb751e"
server_key_version: "encryptionkey@0"
I20260809 18:59:14.792639 13952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:14.815660 13952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:14.817755 13952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:14.817948 13952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:14.822408 13952 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43959
I20260809 18:59:14.822446 14046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43959 every 8 connection(s)
I20260809 18:59:14.822871 13952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:14.823930 14047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:14.826445 14047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Bootstrap starting.
I20260809 18:59:14.827036 14047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:14.827342 14047 log.cc:824] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:14.828100 14047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: No bootstrap required, opened a new log
I20260809 18:59:14.829074 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 13952
I20260809 18:59:14.829180 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:59:14.829371 24468 external_mini_cluster.cc:1428] Setting key 90e4375e80bfe0d935f1f13a6eb17fd5
I20260809 18:59:14.830572 14047 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:14.830765 14047 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:14.830874 14047 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35cac94e0c454c6dbfd9c5f5c2dbe806, State: Initialized, Role: FOLLOWER
I20260809 18:59:14.831066 14047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:14.831174 14047 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:14.831213 14047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:14.831274 14047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:14.832350 14047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:14.832448 14047 leader_election.cc:302] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35cac94e0c454c6dbfd9c5f5c2dbe806; no voters:
I20260809 18:59:14.832695 14047 leader_election.cc:288] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:59:14.832754 14053 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:14.832914 14053 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 LEADER]: Becoming Leader. State: Replica: 35cac94e0c454c6dbfd9c5f5c2dbe806, State: Running, Role: LEADER
I20260809 18:59:14.833055 14053 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:14.833066 14047 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:14.833554 14055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35cac94e0c454c6dbfd9c5f5c2dbe806. Latest consensus state: current_term: 1 leader_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } } }
I20260809 18:59:14.833667 14055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:14.833554 14054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } } }
I20260809 18:59:14.833889 14054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: This master's current role is: LEADER
W20260809 18:59:14.835184 14075 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:59:14.835246 14075 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:59:14.835294 14063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:14.835467 14063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:14.837227 14063 catalog_manager.cc:1347] Generated new cluster ID: 04fa214787e849d78111c7161e6cdf33
Aug 09 18:59:14 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:14.837284 14063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:14.841889 14051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:14.829987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54454 (local address 127.23.229.62:43959)
0809 18:59:14.830209 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:14.830218 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:14.830246 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:59:14.830544 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:14.830551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:14.830603 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:14.830725 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:14.831599 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:14.832658 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:14.833901 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:14.834617 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:14.834711 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:14.837830 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:14.837835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:14.837835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:14.837849 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:14.839927 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:14.840339 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:14.840342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:14.840343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:14.840528 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:14.840742 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:14.840743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:14.840743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:14.841077 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:14.841255 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:14.841341 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 18:59:14.841488 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
I20260809 18:59:14.847005 14063 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:14.847504 14063 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:14.852942 14063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Generated new TSK 0
I20260809 18:59:14.853158 14063 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:59:14.880980 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43959
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:14.970238 14085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:14.970465 14085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:14.970490 14085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:14.971602 14085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:14.971640 14085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:14.971665 14085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:59:14.973225 14085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:14.973465 14085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:14.973658 14085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:14.979115 14096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:14.979106 14092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:14.979271 14085 server_base.cc:1034] running on GCE node
W20260809 18:59:14.979110 14094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:14.979591 14085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:14.979839 14085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:14.980997 14085 hybrid_clock.cc:648] HybridClock initialized: now 1786301954980998 us; error 42 us; skew 500 ppm
Aug 09 18:59:14 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301954, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:14.983747 14085 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:59:14.984215 14085 webserver.cc:460] Webserver started at http://127.23.229.1:44391/ using document root <none> and password file <none>
I20260809 18:59:14.984534 14085 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:14.984613 14085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:14.984778 14085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:14.985869 14085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "df008a4afb4c4089b95e90a46a8f7669"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "0fd5694ed411757e6020a8a637ec8f8b"
server_key_iv: "65d9f5fbc09ff4c921ab70ffa05c8683"
server_key_version: "encryptionkey@0"
I20260809 18:59:14.986258 14085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "df008a4afb4c4089b95e90a46a8f7669"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "0fd5694ed411757e6020a8a637ec8f8b"
server_key_iv: "65d9f5fbc09ff4c921ab70ffa05c8683"
server_key_version: "encryptionkey@0"
I20260809 18:59:14.987668 14085 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:59:14.988685 14106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:14.988883 14085 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:14.989045 14085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "df008a4afb4c4089b95e90a46a8f7669"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "0fd5694ed411757e6020a8a637ec8f8b"
server_key_iv: "65d9f5fbc09ff4c921ab70ffa05c8683"
server_key_version: "encryptionkey@0"
I20260809 18:59:14.989135 14085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:15.032033 14085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:15.034906 14085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:15.035060 14085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:15.035282 14085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:15.035650 14085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:15.035686 14085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.035710 14085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:15.035758 14085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.041911 14085 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:34655
I20260809 18:59:15.041956 14263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:34655 every 8 connection(s)
I20260809 18:59:15.042308 14085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:15.047845 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 14085
I20260809 18:59:15.047956 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:59:15.048154 24468 external_mini_cluster.cc:1428] Setting key 25ff4364fe3b5f544a0a828c1dc6a5a1
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301954, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:15.052706 14051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.043145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:54015 (local address 127.23.229.62:43959)
0809 18:59:15.043216 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.043218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.043429 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:59:15.043968 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.043969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.043984 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.044041 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:15.045059 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.045575 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.046562 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.046769 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.046819 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.049270 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:15.049271 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:15.049272 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:15.049283 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:15.051079 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.051612 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.051612 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.051613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.051665 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.051965 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.051965 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.051966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.052098 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:15.052166 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.052473 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.052600 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:59:15.052904 14268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.043111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:54015)
0809 18:59:15.043292 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.043337 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.043863 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.044108 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.044111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.044751 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:15.044965 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.044970 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.045662 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.045662 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.046486 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.046488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.046845 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.046846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.046954 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.047479 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:15.047488 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:15.049173 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:15.051160 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.051169 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.051172 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.051528 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.051732 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.051733 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.051734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.051886 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.052187 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:15.052195 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:15.052330 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.052458 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.052671 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260809 18:59:15.053481 14265 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43959
I20260809 18:59:15.053599 14265 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:15.053799 14265 heartbeater.cc:511] Master 127.23.229.62:43959 requested a full tablet report, sending...
I20260809 18:59:15.054404 13998 ts_manager.cc:194] Registered new tserver with Master: df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655)
I20260809 18:59:15.055047 13998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:54015
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:59:15.077075 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43959
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:15.163005 14271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:15.163228 14271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:15.163251 14271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:15.164428 14271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:15.164496 14271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:15.164556 14271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:59:15.166044 14271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:15.166299 14271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:15.166565 14271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:15.171801 14280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.171924 14278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.171838 14277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:15.172101 14271 server_base.cc:1034] running on GCE node
I20260809 18:59:15.172334 14271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:15.172621 14271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:15.173784 14271 hybrid_clock.cc:648] HybridClock initialized: now 1786301955173766 us; error 46 us; skew 500 ppm
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:15.176349 14271 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:59:15.176851 14271 webserver.cc:460] Webserver started at http://127.23.229.2:45793/ using document root <none> and password file <none>
I20260809 18:59:15.177047 14271 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:15.177089 14271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:15.177181 14271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:15.178205 14271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "d807ca268cae495bad2c95889c471196"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "ba87fde7c03d863218fba6394d7f4a3a"
server_key_iv: "663325782e3ea0b65e3f2b0ab068a42e"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.178515 14271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "d807ca268cae495bad2c95889c471196"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "ba87fde7c03d863218fba6394d7f4a3a"
server_key_iv: "663325782e3ea0b65e3f2b0ab068a42e"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.179777 14271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:59:15.180521 14288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.180713 14271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:15.180809 14271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "d807ca268cae495bad2c95889c471196"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "ba87fde7c03d863218fba6394d7f4a3a"
server_key_iv: "663325782e3ea0b65e3f2b0ab068a42e"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.180866 14271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:15.190841 14271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:15.193614 14271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:15.193740 14271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:15.193969 14271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:15.194329 14271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:15.194366 14271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.194391 14271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:15.194442 14271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.200625 14271 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:45081
I20260809 18:59:15.200708 14446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:45081 every 8 connection(s)
I20260809 18:59:15.201081 14271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:15.203680 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 14271
I20260809 18:59:15.203822 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 18:59:15.204218 24468 external_mini_cluster.cc:1428] Setting key 90add7cdea17ac1832d18c1367556010
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:15.212891 14051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.201981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:36919 (local address 127.23.229.62:43959)
0809 18:59:15.202167 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.202169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.202350 (+ 181us) server_negotiation.cc:407] Connection header received
0809 18:59:15.202933 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.202935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.202949 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.202993 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:15.204122 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.204922 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.206515 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.206722 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.206792 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.209415 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:15.209416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:15.209417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:15.209427 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:15.211269 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.211717 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.211719 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.211719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.211791 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.212047 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.212049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.212049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.212226 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:15.212309 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.212657 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.212764 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260809 18:59:15.212986 14450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.201858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:36919)
0809 18:59:15.202203 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.202261 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.202809 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.203071 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.203075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.203708 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:15.204000 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.204006 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.205072 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.205074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.206407 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.206410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.206846 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.206847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.207010 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.207669 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:15.207678 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:15.209305 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:15.211386 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.211394 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.211396 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.211630 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.211868 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.211869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.211869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.211975 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.212298 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:15.212303 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:15.212436 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.212605 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.212761 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":123,"threads_started":1}
I20260809 18:59:15.213563 14447 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43959
I20260809 18:59:15.213689 14447 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:15.213896 14447 heartbeater.cc:511] Master 127.23.229.62:43959 requested a full tablet report, sending...
I20260809 18:59:15.214354 13998 ts_manager.cc:194] Registered new tserver with Master: d807ca268cae495bad2c95889c471196 (127.23.229.2:45081)
I20260809 18:59:15.214752 13998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:36919
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:59:15.232805 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43959
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:15.319357 14455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:15.319573 14455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:15.319597 14455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:15.320684 14455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:15.320719 14455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:15.320744 14455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:59:15.322118 14455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:15.322307 14455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:15.322489 14455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:59:15.327796 14455 server_base.cc:1034] running on GCE node
W20260809 18:59:15.327780 14461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.327780 14464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.327778 14462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:15.328176 14455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:15.328531 14455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:15.329696 14455 hybrid_clock.cc:648] HybridClock initialized: now 1786301955329687 us; error 30 us; skew 500 ppm
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:15.332355 14455 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:59:15.332834 14455 webserver.cc:460] Webserver started at http://127.23.229.3:34417/ using document root <none> and password file <none>
I20260809 18:59:15.333084 14455 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:15.333132 14455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:15.333223 14455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:15.334406 14455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "21342ed1ca014e8b985b02c61add01b6"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "13431fbb85da52f437667969b3afc0c0"
server_key_iv: "ba66a11f378accad05302641fdd0f283"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.334780 14455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "21342ed1ca014e8b985b02c61add01b6"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "13431fbb85da52f437667969b3afc0c0"
server_key_iv: "ba66a11f378accad05302641fdd0f283"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.336115 14455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:59:15.336917 14473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.337118 14455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.337211 14455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "21342ed1ca014e8b985b02c61add01b6"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "13431fbb85da52f437667969b3afc0c0"
server_key_iv: "ba66a11f378accad05302641fdd0f283"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.337286 14455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:15.345482 14455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:15.347818 14455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:15.347934 14455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:15.348162 14455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:15.348555 14455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:15.348596 14455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.348619 14455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:15.348663 14455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.354943 14455 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:43845
I20260809 18:59:15.355017 14661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:43845 every 8 connection(s)
I20260809 18:59:15.355387 14455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:15.358785 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 14455
I20260809 18:59:15.358886 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:59:15.359054 24468 external_mini_cluster.cc:1428] Setting key 39693591aff078de1d4c53439985eaea
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:15.364949 14051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.356196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:51825 (local address 127.23.229.62:43959)
0809 18:59:15.356272 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.356275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.356530 (+ 255us) server_negotiation.cc:407] Connection header received
0809 18:59:15.357084 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.357085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.357097 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.357153 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:15.358129 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.358659 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.359942 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.360166 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.360247 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.362480 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:15.362482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:15.362482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:15.362495 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:15.363716 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.364092 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.364093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.364093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.364147 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.364362 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.364362 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.364363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.364467 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:15.364579 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.364815 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.364883 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:59:15.365116 14671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.356182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:51825)
0809 18:59:15.356373 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.356412 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.356985 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.357211 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.357214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.357835 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:15.358045 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.358049 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.358759 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.358760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.359840 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.359843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.360258 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.360259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.360387 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.360943 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:15.360952 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:15.362385 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:15.363791 (+ 1406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.363797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.363799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.364023 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.364207 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.364208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.364208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.364307 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.364580 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:15.364585 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:15.364703 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.364785 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.364909 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":109,"threads_started":1}
I20260809 18:59:15.365623 14668 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43959
I20260809 18:59:15.365752 14668 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:15.365953 14668 heartbeater.cc:511] Master 127.23.229.62:43959 requested a full tablet report, sending...
I20260809 18:59:15.366344 13998 ts_manager.cc:194] Registered new tserver with Master: 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
I20260809 18:59:15.366729 13998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:51825
I20260809 18:59:15.370846 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:15.378109 14051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.372272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.23.229.62:43959)
0809 18:59:15.372336 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.372338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.372537 (+ 199us) server_negotiation.cc:407] Connection header received
0809 18:59:15.372587 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.372588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.372597 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.372644 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:15.373183 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.373642 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.374354 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.374534 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.374582 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.375794 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:15.375795 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:15.375795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:15.375802 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:15.377121 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.377423 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.377424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.377424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.377475 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.377639 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.377639 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.377639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.377779 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:15.377856 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.377963 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.378024 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:59:15.379817 13998 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:15.382589 13998 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:59:15.391515 14691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.386216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57648 (local address 127.23.229.3:43845)
0809 18:59:15.386506 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.386509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.386520 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:15.386709 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.386712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.386728 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.386802 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:15.387662 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.388765 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.390488 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.391038 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.391148 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.391212 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.391368 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.391411 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":92,"threads_started":1}
I20260809 18:59:15.391553 14689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.385973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:45081 (local address 127.0.0.1:59802)
0809 18:59:15.386572 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.386597 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.386685 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.387230 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.387231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.387233 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:15.387291 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.387293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.388711 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.388712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.390199 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.390202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.391254 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.391255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.391329 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.391334 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.391388 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.391462 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":72,"thread_start_us":72,"threads_started":1}
I20260809 18:59:15.391634 14692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.386247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59596 (local address 127.23.229.1:34655)
0809 18:59:15.387014 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.387018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.387029 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:15.387073 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.387076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.387092 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.387184 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:15.387439 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.388593 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.390226 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.391061 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.391142 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.391209 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.391492 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.391540 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":85,"threads_started":1}
I20260809 18:59:15.391916 14690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.386230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59802 (local address 127.23.229.2:45081)
0809 18:59:15.386422 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.386428 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.386967 (+ 539us) server_negotiation.cc:407] Connection header received
0809 18:59:15.387017 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.387020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.387037 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.387117 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:15.387386 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.388600 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.390288 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.391061 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.391142 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.391209 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.391795 (+ 586us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.391835 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":74,"threads_started":1}
I20260809 18:59:15.392125 14687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.385988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34655 (local address 127.0.0.1:59596)
0809 18:59:15.386763 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.386771 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.386807 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.387287 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.387288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.387290 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:15.387344 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.387346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.388721 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.388722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.390093 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.390096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.391252 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.391254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.391332 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.391335 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.391388 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.391751 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"mutex_wait_us":87,"thread_start_us":86,"threads_started":1}
I20260809 18:59:15.392297 14688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.385950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:43845 (local address 127.0.0.1:57648)
0809 18:59:15.386422 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.386471 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.386591 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.386846 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.386852 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.386856 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:15.386972 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.386975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.388868 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.388869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.390395 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.390397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.391154 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.391155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.391244 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.391259 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.391349 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.391445 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":78,"thread_start_us":72,"threads_started":1}
I20260809 18:59:15.392758 14355 tablet_service.cc:1467] Processing CreateTablet for tablet 18f899e7701942788e08c7c0842c062e (DEFAULT_TABLE table=test-table [id=b0f2bab449f6442093be68fe4a9a1263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:15.392942 14167 tablet_service.cc:1467] Processing CreateTablet for tablet 18f899e7701942788e08c7c0842c062e (DEFAULT_TABLE table=test-table [id=b0f2bab449f6442093be68fe4a9a1263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:15.392994 14548 tablet_service.cc:1467] Processing CreateTablet for tablet 18f899e7701942788e08c7c0842c062e (DEFAULT_TABLE table=test-table [id=b0f2bab449f6442093be68fe4a9a1263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:15.393226 14355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18f899e7701942788e08c7c0842c062e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:15.393302 14548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18f899e7701942788e08c7c0842c062e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:15.393302 14167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18f899e7701942788e08c7c0842c062e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:15.396404 14695 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Bootstrap starting.
I20260809 18:59:15.397193 14695 tablet_bootstrap.cc:654] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:15.397729 14695 log.cc:824] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:15.398093 14698 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Bootstrap starting.
I20260809 18:59:15.398677 14695 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: No bootstrap required, opened a new log
I20260809 18:59:15.398766 14695 ts_tablet_manager.cc:1397] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:15.400151 14695 raft_consensus.cc:348] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.400292 14695 raft_consensus.cc:374] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:15.400314 14695 raft_consensus.cc:729] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d807ca268cae495bad2c95889c471196, State: Initialized, Role: FOLLOWER
I20260809 18:59:15.400447 14695 consensus_queue.cc:260] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.400753 14695 ts_tablet_manager.cc:1428] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:15.400754 14700 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Bootstrap starting.
I20260809 18:59:15.400827 14447 heartbeater.cc:503] Master 127.23.229.62:43959 was elected leader, sending a full tablet report...
I20260809 18:59:15.401551 14700 tablet_bootstrap.cc:654] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:15.402172 14700 log.cc:824] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:15.402920 14698 tablet_bootstrap.cc:654] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:15.403172 14700 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: No bootstrap required, opened a new log
I20260809 18:59:15.403229 14700 ts_tablet_manager.cc:1397] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:15.403465 14698 log.cc:824] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:15.404186 14698 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: No bootstrap required, opened a new log
I20260809 18:59:15.404273 14698 ts_tablet_manager.cc:1397] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260809 18:59:15.404783 14700 raft_consensus.cc:348] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.404922 14700 raft_consensus.cc:374] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:15.404945 14700 raft_consensus.cc:729] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21342ed1ca014e8b985b02c61add01b6, State: Initialized, Role: FOLLOWER
I20260809 18:59:15.405082 14700 consensus_queue.cc:260] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.405364 14700 ts_tablet_manager.cc:1428] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:15.405434 14668 heartbeater.cc:503] Master 127.23.229.62:43959 was elected leader, sending a full tablet report...
I20260809 18:59:15.406145 14698 raft_consensus.cc:348] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.406311 14698 raft_consensus.cc:374] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:15.406363 14698 raft_consensus.cc:729] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df008a4afb4c4089b95e90a46a8f7669, State: Initialized, Role: FOLLOWER
I20260809 18:59:15.406479 14698 consensus_queue.cc:260] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.406780 14698 ts_tablet_manager.cc:1428] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:59:15.406800 14265 heartbeater.cc:503] Master 127.23.229.62:43959 was elected leader, sending a full tablet report...
I20260809 18:59:15.425436 14708 raft_consensus.cc:482] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:15.425590 14708 raft_consensus.cc:504] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.425989 14708 leader_election.cc:288] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655), d807ca268cae495bad2c95889c471196 (127.23.229.2:45081)
I20260809 18:59:15.428913 14692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.426249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:40691 (local address 127.23.229.1:34655)
0809 18:59:15.426313 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.426315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.426326 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:15.426362 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.426363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.426373 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.426436 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:15.426626 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.427124 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.428089 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.428532 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.428626 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.428637 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.428794 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.428835 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:59:15.428913 14671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.426170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34655 (local address 127.23.229.3:40691)
0809 18:59:15.426242 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.426254 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.426298 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.426462 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.426463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.426464 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:15.426548 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.426550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.427223 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.427224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.427964 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.427966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.428620 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.428621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.428713 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.428716 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.428785 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.428834 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 18:59:15.429105 14690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.426282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:56371 (local address 127.23.229.2:45081)
0809 18:59:15.426330 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.426332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.426495 (+ 163us) server_negotiation.cc:407] Connection header received
0809 18:59:15.426578 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.426579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.426587 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.426653 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:15.426812 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.427286 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.428276 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.428733 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.428837 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.428847 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.429004 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.429044 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:59:15.429111 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.426183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:45081 (local address 127.23.229.3:56371)
0809 18:59:15.426430 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.426442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.426507 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.426659 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.426660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.426663 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:15.426741 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.426742 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.427377 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.427378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.428189 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.428192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.428838 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.428839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.428912 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.428915 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.428979 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.429022 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":129,"threads_started":1}
I20260809 18:59:15.429360 14197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f899e7701942788e08c7c0842c062e" candidate_uuid: "21342ed1ca014e8b985b02c61add01b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df008a4afb4c4089b95e90a46a8f7669" is_pre_election: true
I20260809 18:59:15.429441 14387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f899e7701942788e08c7c0842c062e" candidate_uuid: "21342ed1ca014e8b985b02c61add01b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d807ca268cae495bad2c95889c471196" is_pre_election: true
I20260809 18:59:15.429569 14197 raft_consensus.cc:2454] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21342ed1ca014e8b985b02c61add01b6 in term 0.
I20260809 18:59:15.429628 14387 raft_consensus.cc:2454] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21342ed1ca014e8b985b02c61add01b6 in term 0.
I20260809 18:59:15.429834 14477 leader_election.cc:302] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21342ed1ca014e8b985b02c61add01b6, df008a4afb4c4089b95e90a46a8f7669; no voters:
I20260809 18:59:15.429972 14708 raft_consensus.cc:2781] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:15.430032 14708 raft_consensus.cc:482] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:15.430064 14708 raft_consensus.cc:3037] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:15.430840 14708 raft_consensus.cc:504] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.431020 14708 leader_election.cc:288] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [CANDIDATE]: Term 1 election: Requested vote from peers df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655), d807ca268cae495bad2c95889c471196 (127.23.229.2:45081)
I20260809 18:59:15.431174 14197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f899e7701942788e08c7c0842c062e" candidate_uuid: "21342ed1ca014e8b985b02c61add01b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df008a4afb4c4089b95e90a46a8f7669"
I20260809 18:59:15.431228 14387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f899e7701942788e08c7c0842c062e" candidate_uuid: "21342ed1ca014e8b985b02c61add01b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d807ca268cae495bad2c95889c471196"
I20260809 18:59:15.431283 14197 raft_consensus.cc:3037] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:15.431301 14387 raft_consensus.cc:3037] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:15.432248 14387 raft_consensus.cc:2454] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21342ed1ca014e8b985b02c61add01b6 in term 1.
I20260809 18:59:15.432247 14197 raft_consensus.cc:2454] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21342ed1ca014e8b985b02c61add01b6 in term 1.
I20260809 18:59:15.432495 14477 leader_election.cc:302] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21342ed1ca014e8b985b02c61add01b6, df008a4afb4c4089b95e90a46a8f7669; no voters:
I20260809 18:59:15.432587 14708 raft_consensus.cc:2781] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:15.432765 14708 raft_consensus.cc:686] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 1 LEADER]: Becoming Leader. State: Replica: 21342ed1ca014e8b985b02c61add01b6, State: Running, Role: LEADER
I20260809 18:59:15.432889 14708 consensus_queue.cc:237] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.433811 13998 catalog_manager.cc:5495] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "21342ed1ca014e8b985b02c61add01b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } health_report { overall_health: UNKNOWN } } }
I20260809 18:59:15.449645 14691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.447093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57650 (local address 127.23.229.3:43845)
0809 18:59:15.447156 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.447158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.447168 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:59:15.447242 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.447242 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.447261 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.447341 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:15.447490 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.447969 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.448802 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.449017 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.449095 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.449273 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:15.449384 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:15.449489 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.449507 (+ 18us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.449528 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:59:15.451625 14197 raft_consensus.cc:1261] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Refusing update from remote peer 21342ed1ca014e8b985b02c61add01b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:15.451623 14387 raft_consensus.cc:1261] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 1 FOLLOWER]: Refusing update from remote peer 21342ed1ca014e8b985b02c61add01b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260809 18:59:15.451623 14449 tablet.cc:2369] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:15.452054 14708 consensus_queue.cc:1035] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:15.452210 14715 consensus_queue.cc:1035] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:15.454674 14721 mvcc.cc:205] Tried to move back new op lower bound from 7316692809526607872 to 7316692809453862912. Current Snapshot: MvccSnapshot[applied={T|T < 7316692809526607872}]
I20260809 18:59:15.455024 14722 mvcc.cc:205] Tried to move back new op lower bound from 7316692809526607872 to 7316692809453862912. Current Snapshot: MvccSnapshot[applied={T|T < 7316692809526607872}]
I20260809 18:59:15.455510 14725 mvcc.cc:205] Tried to move back new op lower bound from 7316692809526607872 to 7316692809453862912. Current Snapshot: MvccSnapshot[applied={T|T < 7316692809526607872}]
I20260809 18:59:15.457858 13998 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:15.457968 13998 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:15.458818 13998 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Sending DeleteTablet for 3 replicas of tablet 18f899e7701942788e08c7c0842c062e
I20260809 18:59:15.459183 14167 tablet_service.cc:1514] Processing DeleteTablet for tablet 18f899e7701942788e08c7c0842c062e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:15 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:59596
I20260809 18:59:15.459170 14548 tablet_service.cc:1514] Processing DeleteTablet for tablet 18f899e7701942788e08c7c0842c062e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:15 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:57648
I20260809 18:59:15.459264 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 14085
I20260809 18:59:15.459247 14355 tablet_service.cc:1514] Processing DeleteTablet for tablet 18f899e7701942788e08c7c0842c062e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:15 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:59802
I20260809 18:59:15.472666 14736 tablet_replica.cc:330] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: stopping tablet replica
I20260809 18:59:15.472894 14736 raft_consensus.cc:2229] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:15.473067 14736 raft_consensus.cc:2258] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:15.473697 14736 ts_tablet_manager.cc:1905] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:15.475666 14736 ts_tablet_manager.cc:1918] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:15.475775 14736 log.cc:1196] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/18f899e7701942788e08c7c0842c062e
I20260809 18:59:15.476064 14736 ts_tablet_manager.cc:1939] T 18f899e7701942788e08c7c0842c062e P d807ca268cae495bad2c95889c471196: Deleting consensus metadata
I20260809 18:59:15.478432 13975 catalog_manager.cc:4841] TS d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): tablet 18f899e7701942788e08c7c0842c062e (table test-table [id=b0f2bab449f6442093be68fe4a9a1263]) successfully deleted
I20260809 18:59:15.478591 14735 tablet_replica.cc:330] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: stopping tablet replica
I20260809 18:59:15.478751 14735 raft_consensus.cc:2229] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:59:15.478919 14735 raft_consensus.cc:2258] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:15.479354 14735 ts_tablet_manager.cc:1905] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:15.480667 14735 ts_tablet_manager.cc:1918] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:15.480755 14735 log.cc:1196] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/18f899e7701942788e08c7c0842c062e
I20260809 18:59:15.481015 14735 ts_tablet_manager.cc:1939] T 18f899e7701942788e08c7c0842c062e P 21342ed1ca014e8b985b02c61add01b6: Deleting consensus metadata
I20260809 18:59:15.481477 13972 catalog_manager.cc:4841] TS 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): tablet 18f899e7701942788e08c7c0842c062e (table test-table [id=b0f2bab449f6442093be68fe4a9a1263]) successfully deleted
W20260809 18:59:15.484681 13973 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:34655 (error 108)
I20260809 18:59:15.485275 14687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.485145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34655 (local address 127.0.0.1:59612)
0809 18:59:15.485200 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.485243 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:59:15.485423 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 14271
W20260809 18:59:15.495921 13973 catalog_manager.cc:4584] TS df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 18f899e7701942788e08c7c0842c062e: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34655: connect: Connection refused (error 111)
I20260809 18:59:15.500133 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 14455
I20260809 18:59:15.517840 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 13952
I20260809 18:59:15.532371 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43959
--webserver_interface=127.23.229.62
--webserver_port=45681
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:15.618057 14740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:15.618270 14740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:15.618294 14740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:15.619447 14740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:15.619495 14740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:15.619510 14740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:15.619522 14740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:15.619534 14740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:15.621151 14740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=45681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:15.621439 14740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:15.621683 14740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:15.630893 14752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.630893 14749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.630988 14750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:15.631233 14740 server_base.cc:1034] running on GCE node
I20260809 18:59:15.631520 14740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:15.631904 14740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:15.633098 14740 hybrid_clock.cc:648] HybridClock initialized: now 1786301955633083 us; error 49 us; skew 500 ppm
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:15.638553 14740 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:15.639087 14740 webserver.cc:460] Webserver started at http://127.23.229.62:45681/ using document root <none> and password file <none>
I20260809 18:59:15.639331 14740 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:15.639389 14740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:15.640882 14740 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:59:15.641588 14765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.641793 14740 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:15.641894 14740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "bace1d74aa95caf31fdbdb10449b55ff"
server_key_iv: "04730e2195ca1ea252151d8dbabb751e"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.642323 14740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:15.658710 14740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:15.660712 14740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:15.660872 14740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:15.665023 14740 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43959
I20260809 18:59:15.665057 14849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43959 every 8 connection(s)
I20260809 18:59:15.665467 14740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:15.667186 14851 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:59:15.667825 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 14740
I20260809 18:59:15.667865 14851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Bootstrap starting.
I20260809 18:59:15.668152 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:34655
--local_ip_for_outbound_sockets=127.23.229.1
--tserver_master_addrs=127.23.229.62:43959
--webserver_port=44391
--webserver_interface=127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:15.678354 14851 log.cc:824] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:15.680562 14851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:15.680889 14851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Bootstrap complete.
I20260809 18:59:15.683408 14851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:15.683671 14851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35cac94e0c454c6dbfd9c5f5c2dbe806, State: Initialized, Role: FOLLOWER
I20260809 18:59:15.683887 14851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:15.683993 14851 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:15.684058 14851 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:15.684109 14851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:59:15.685225 14851 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:15.685351 14851 leader_election.cc:302] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35cac94e0c454c6dbfd9c5f5c2dbe806; no voters:
I20260809 18:59:15.685583 14851 leader_election.cc:288] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:59:15.685621 14858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:59:15.685734 14858 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 LEADER]: Becoming Leader. State: Replica: 35cac94e0c454c6dbfd9c5f5c2dbe806, State: Running, Role: LEADER
I20260809 18:59:15.685832 14858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:15.685869 14851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:15.686106 14858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35cac94e0c454c6dbfd9c5f5c2dbe806. Latest consensus state: current_term: 2 leader_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } } }
I20260809 18:59:15.686185 14858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:15.686115 14859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } } }
I20260809 18:59:15.686247 14859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:15.686625 14862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:15.687561 14862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:15.687680 14862 catalog_manager.cc:1259] Loaded cluster ID: 04fa214787e849d78111c7161e6cdf33
I20260809 18:59:15.687718 14862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:15.687963 14862 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 18:59:15.692718 14862 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 18:59:15.695214 14862 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:15.695448 14862 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Loaded TSK: 0
I20260809 18:59:15.695674 14862 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:59:15.757793 14854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:15.758040 14854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:15.758085 14854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:15.759266 14854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:15.759335 14854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:15.759385 14854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:59:15.760937 14854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:34655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=44391
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:15.761212 14854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:15.761457 14854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:15.766844 14890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.767004 14895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.766860 14892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:15.767215 14854 server_base.cc:1034] running on GCE node
I20260809 18:59:15.767424 14854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:15.767699 14854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:15.768851 14854 hybrid_clock.cc:648] HybridClock initialized: now 1786301955768833 us; error 36 us; skew 500 ppm
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:15.772542 14854 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:59:15.773200 14854 webserver.cc:460] Webserver started at http://127.23.229.1:44391/ using document root <none> and password file <none>
I20260809 18:59:15.773554 14854 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:15.773640 14854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:15.775785 14854 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:15.776670 14905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.776880 14854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:15.776988 14854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "df008a4afb4c4089b95e90a46a8f7669"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "0fd5694ed411757e6020a8a637ec8f8b"
server_key_iv: "65d9f5fbc09ff4c921ab70ffa05c8683"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.777549 14854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:15.810622 14854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:15.813604 14854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:15.813779 14854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:15.814066 14854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:15.814659 14915 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 18:59:15.817008 14854 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:59:15.817144 14854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260809 18:59:15.817268 14854 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:59:15.818271 14854 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:59:15.818398 14915 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Bootstrap starting.
I20260809 18:59:15.818457 14854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:15.826334 14854 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:34655
I20260809 18:59:15.826408 15083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:34655 every 8 connection(s)
I20260809 18:59:15.826923 14854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:15.830358 14915 log.cc:824] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:15.834630 14915 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:15.835021 14915 tablet_bootstrap.cc:492] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Bootstrap complete.
I20260809 18:59:15.835482 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 14854
I20260809 18:59:15.835773 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:45081
--local_ip_for_outbound_sockets=127.23.229.2
--tserver_master_addrs=127.23.229.62:43959
--webserver_port=45793
--webserver_interface=127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:15.836387 14915 ts_tablet_manager.cc:1397] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.010s
I20260809 18:59:15.838271 14915 raft_consensus.cc:348] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.838687 14915 raft_consensus.cc:729] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: df008a4afb4c4089b95e90a46a8f7669, State: Initialized, Role: FOLLOWER
I20260809 18:59:15.838840 14915 consensus_queue.cc:260] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } } peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } }
I20260809 18:59:15.839159 14915 ts_tablet_manager.cc:1428] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:15.848110 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.827782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:57279)
0809 18:59:15.830730 (+ 2948us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.830783 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.831724 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.834965 (+ 3241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.834970 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.835435 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:15.836107 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.836118 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.838004 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.838005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.839493 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.839497 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.840371 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.840372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.840535 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.841215 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:15.841226 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:15.843155 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:15.846045 (+ 2890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.846053 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.846055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.846444 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.846777 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.846778 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.846779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.846931 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.847510 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:15.847516 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:15.847714 (+ 198us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.847821 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.847959 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2897,"thread_start_us":139,"threads_started":1}
I20260809 18:59:15.848332 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.827842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:57279 (local address 127.23.229.62:43959)
0809 18:59:15.829120 (+ 1278us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.829130 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.830975 (+ 1845us) server_negotiation.cc:407] Connection header received
0809 18:59:15.832018 (+ 1043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.832026 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.832089 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.832259 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:15.836323 (+ 4064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.837874 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.839597 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.840170 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.840241 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.843291 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:15.843296 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:15.843297 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:15.843310 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:15.845943 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.846554 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.846558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.846559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.846689 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.847030 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.847032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.847032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.847393 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:15.847504 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.847933 (+ 429us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.848100 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1219,"thread_start_us":85,"threads_started":1}
I20260809 18:59:15.849071 15085 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43959
I20260809 18:59:15.849192 15085 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:15.849433 15085 heartbeater.cc:511] Master 127.23.229.62:43959 requested a full tablet report, sending...
I20260809 18:59:15.850216 14788 ts_manager.cc:194] Registered new tserver with Master: df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655)
I20260809 18:59:15.851418 14788 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:57279
I20260809 18:59:15.852272 15085 heartbeater.cc:503] Master 127.23.229.62:43959 was elected leader, sending a full tablet report...
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:59:15.859514 15095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.850816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34655 (local address 127.0.0.1:59618)
0809 18:59:15.851015 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.851065 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.851138 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.851365 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.851372 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.851750 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:15.851809 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.851811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.853154 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.853155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.853723 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.853725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.854335 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.854335 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.854398 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.854918 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:15.854923 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:15.856375 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:15.858434 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.858441 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.858443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.858639 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.858865 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.858865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.858866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.858922 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.859231 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:15.859238 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:15.859280 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.859344 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.859443 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":98,"threads_started":1}
I20260809 18:59:15.859603 15097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.851068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.23.229.1:34655)
0809 18:59:15.851206 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.851210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.851220 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:59:15.851252 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.851254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.851268 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.851344 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:15.851909 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.853062 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.853802 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.854259 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.854332 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.856466 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:15.856535 (+ 69us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:15.856536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:15.856544 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:15.858338 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.858726 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.858729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.858729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.858795 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.858982 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.858983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.858984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.859166 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:15.859251 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.859400 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.859507 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260809 18:59:15.860307 14977 tablet_service.cc:1514] Processing DeleteTablet for tablet 18f899e7701942788e08c7c0842c062e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:15 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:59618
I20260809 18:59:15.860932 15098 tablet_replica.cc:330] stopping tablet replica
I20260809 18:59:15.861047 15098 raft_consensus.cc:2229] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:15.861120 15098 raft_consensus.cc:2258] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:15.861471 15098 ts_tablet_manager.cc:1905] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:15.863727 15098 ts_tablet_manager.cc:1918] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:15.863819 15098 log.cc:1196] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/18f899e7701942788e08c7c0842c062e
I20260809 18:59:15.864068 15098 ts_tablet_manager.cc:1939] T 18f899e7701942788e08c7c0842c062e P df008a4afb4c4089b95e90a46a8f7669: Deleting consensus metadata
I20260809 18:59:15.864667 14767 catalog_manager.cc:4841] TS df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655): tablet 18f899e7701942788e08c7c0842c062e (table test-table [id=b0f2bab449f6442093be68fe4a9a1263]) successfully deleted
W20260809 18:59:15.929858 15093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:15.930074 15093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:15.930097 15093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:15.931353 15093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:15.931421 15093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:15.931468 15093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:59:15.933631 15093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:45081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=45793
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:15.933936 15093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:15.934216 15093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:15.939538 15107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.939535 15111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:15.939591 15105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:15.939796 15093 server_base.cc:1034] running on GCE node
I20260809 18:59:15.940038 15093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:15.940335 15093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:15.941504 15093 hybrid_clock.cc:648] HybridClock initialized: now 1786301955941478 us; error 40 us; skew 500 ppm
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:15.944288 15093 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:59:15.945003 15093 webserver.cc:460] Webserver started at http://127.23.229.2:45793/ using document root <none> and password file <none>
I20260809 18:59:15.945307 15093 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:15.945372 15093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:15.946694 15093 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:59:15.947348 15121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.947530 15093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:59:15.947620 15093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "d807ca268cae495bad2c95889c471196"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "ba87fde7c03d863218fba6394d7f4a3a"
server_key_iv: "663325782e3ea0b65e3f2b0ab068a42e"
server_key_version: "encryptionkey@0"
I20260809 18:59:15.947980 15093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:15.965850 15093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:15.967793 15093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:15.967970 15093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:15.968226 15093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:15.968634 15093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:15.968688 15093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.968734 15093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:15.968760 15093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:15.974972 15093 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:45081
I20260809 18:59:15.975021 15307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:45081 every 8 connection(s)
I20260809 18:59:15.975385 15093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:59:15 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:15.984583 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.976180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43487 (local address 127.23.229.62:43959)
0809 18:59:15.976243 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:15.976245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:15.976454 (+ 209us) server_negotiation.cc:407] Connection header received
0809 18:59:15.977014 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:15.977015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:15.977030 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:15.977088 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:15.978031 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.978539 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.979516 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.979715 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.979767 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.982019 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:15.982021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:15.982021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:15.982028 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:15.983350 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.983729 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.983730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.983730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.983782 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:15.983998 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:15.983999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:15.983999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:15.984103 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:15.984154 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:15.984390 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 18:59:15.984464 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:59:15.984815 15312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:15.976137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:43487)
0809 18:59:15.976316 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:15.976361 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:15.976919 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:15.977154 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:15.977158 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:15.977742 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:15.977948 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.977953 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.978623 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.978624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.979440 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:15.979442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:15.979792 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:15.979793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:15.979900 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:15.980393 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:15.980401 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:15.981908 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:15.983425 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.983433 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.983435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.983660 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.983839 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:15.983840 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:15.983840 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:15.983942 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:15.984156 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:15.984160 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:15.984280 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 18:59:15.984363 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:59:15.984551 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260809 18:59:15.985179 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 15093
I20260809 18:59:15.985347 15310 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43959
I20260809 18:59:15.985481 15310 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:15.985487 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:43845
--local_ip_for_outbound_sockets=127.23.229.3
--tserver_master_addrs=127.23.229.62:43959
--webserver_port=34417
--webserver_interface=127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:15.985735 15310 heartbeater.cc:511] Master 127.23.229.62:43959 requested a full tablet report, sending...
I20260809 18:59:15.986136 14788 ts_manager.cc:194] Registered new tserver with Master: d807ca268cae495bad2c95889c471196 (127.23.229.2:45081)
I20260809 18:59:15.986584 14788 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:43487
W20260809 18:59:16.074739 15313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:16.074963 15313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:16.074990 15313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:16.076221 15313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:16.076269 15313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:16.076324 15313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:59:16.077848 15313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:43845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=34417
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:16.078116 15313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:16.078367 15313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:59:16.083911 15313 server_base.cc:1034] running on GCE node
W20260809 18:59:16.083964 15319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.083964 15320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.083964 15323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:16.084347 15313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:16.084637 15313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:16.085788 15313 hybrid_clock.cc:648] HybridClock initialized: now 1786301956085773 us; error 30 us; skew 500 ppm
Aug 09 18:59:16 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:16.088711 15313 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:59:16.089118 15313 webserver.cc:460] Webserver started at http://127.23.229.3:34417/ using document root <none> and password file <none>
I20260809 18:59:16.089334 15313 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:16.089394 15313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:16.090713 15313 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:16.091329 15332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.091516 15313 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.091610 15313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "21342ed1ca014e8b985b02c61add01b6"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "13431fbb85da52f437667969b3afc0c0"
server_key_iv: "ba66a11f378accad05302641fdd0f283"
server_key_version: "encryptionkey@0"
I20260809 18:59:16.092020 15313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:16.121299 15313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:16.123284 15313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:16.123467 15313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:16.123739 15313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:16.124081 15313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:16.124140 15313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.124176 15313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:16.124223 15313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.130254 15313 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:43845
I20260809 18:59:16.130306 15491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:43845 every 8 connection(s)
I20260809 18:59:16.130656 15313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:16.132431 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 15313
Aug 09 18:59:16 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:16.140324 15501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.132918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41676 (local address 127.23.229.62:43959)
0809 18:59:16.133225 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.133227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.133232 (+ 5us) server_negotiation.cc:407] Connection header received
0809 18:59:16.133252 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.133252 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.133261 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.133309 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:16.133984 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.134512 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.135563 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.135864 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.135915 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.137191 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:16.137193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:16.137193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:16.137201 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:16.139032 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:16.139461 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:16.139462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:16.139463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:16.139519 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:16.139735 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:16.139735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:16.139736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:16.139843 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:16.140061 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.140102 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.140184 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":91,"threads_started":1}
I20260809 18:59:16.141324 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.131367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:52923 (local address 127.23.229.62:43959)
0809 18:59:16.131444 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.131448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.131648 (+ 200us) server_negotiation.cc:407] Connection header received
0809 18:59:16.132156 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.132157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.132168 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.132255 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:16.133551 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.134111 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.135477 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.135775 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.135844 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.138193 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:16.138195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:16.138195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:16.138203 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:16.139819 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:16.140214 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:16.140215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:16.140215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:16.140300 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:16.140653 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:16.140655 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:16.140655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:16.140787 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:16.140828 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.141160 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.141242 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:59:16.141546 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.131323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:52923)
0809 18:59:16.131504 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.131549 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:16.132064 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:16.132323 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:16.132327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:16.133169 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:16.133456 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.133461 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.134206 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.134207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.135384 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.135387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.135869 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.135870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.136022 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.136710 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:16.136718 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:16.138090 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:16.139895 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:16.139902 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:16.139904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:16.140133 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:16.140380 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:16.140381 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:16.140381 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:16.140560 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:16.140882 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:16.140888 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:16.141014 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 18:59:16.141120 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:59:16.141291 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260809 18:59:16.142062 15494 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43959
I20260809 18:59:16.142179 15494 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:16.142373 15494 heartbeater.cc:511] Master 127.23.229.62:43959 requested a full tablet report, sending...
I20260809 18:59:16.142766 14788 ts_manager.cc:194] Registered new tserver with Master: 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
I20260809 18:59:16.143158 14788 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:52923
I20260809 18:59:16.152282 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:16.155197 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.152727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41678 (local address 127.23.229.62:43959)
0809 18:59:16.152790 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.152792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.152886 (+ 94us) server_negotiation.cc:407] Connection header received
0809 18:59:16.152944 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.152945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.152988 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.153068 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:16.153199 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.153707 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.154437 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.154686 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.154752 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.154918 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:16.155024 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:16.155090 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.155122 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.155138 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:59:16.155529 14788 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:41678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:16.157308 14788 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:59:16.159685 14977 tablet_service.cc:1467] Processing CreateTablet for tablet 7b621d8328054bf8ab8ebecfe0883dfb (DEFAULT_TABLE table=test-table [id=e10c2f7d12b24f789bcaef9e59772d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:16.159914 14977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b621d8328054bf8ab8ebecfe0883dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:16.161648 14915 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Bootstrap starting.
I20260809 18:59:16.162024 14915 tablet_bootstrap.cc:654] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:16.162909 14915 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: No bootstrap required, opened a new log
I20260809 18:59:16.162986 14915 ts_tablet_manager.cc:1397] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:16.163147 14915 raft_consensus.cc:348] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.163239 14915 raft_consensus.cc:374] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:16.163287 14915 raft_consensus.cc:729] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df008a4afb4c4089b95e90a46a8f7669, State: Initialized, Role: FOLLOWER
I20260809 18:59:16.163339 14915 consensus_queue.cc:260] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.163431 14915 ts_tablet_manager.cc:1428] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.163803 15095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.159383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:45081 (local address 127.0.0.1:59814)
0809 18:59:16.159488 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.159500 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:16.159546 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:16.159932 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:16.159933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:16.159935 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:16.159994 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.159996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.161198 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.161199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.162354 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.162356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.163530 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.163532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.163606 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.163626 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 18:59:16.163685 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 18:59:16.163731 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 18:59:16.163823 15504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.159515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59814 (local address 127.23.229.2:45081)
0809 18:59:16.159753 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.159758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.159770 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:59:16.159814 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.159817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.159835 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.159929 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:16.160064 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.161085 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.162479 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.163453 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.163519 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.163587 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.163701 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.163746 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":123,"threads_started":1}
I20260809 18:59:16.164304 15503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.159409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:43845 (local address 127.0.0.1:57656)
0809 18:59:16.160579 (+ 1170us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.160591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:16.160651 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:16.160865 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:16.160866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:16.160868 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:16.160926 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.160927 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.162070 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.162071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.163136 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.163139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.164067 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.164068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.164136 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.164141 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:59:16.164200 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 18:59:16.164240 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"thread_start_us":68,"threads_started":1}
I20260809 18:59:16.164345 15506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.159631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57656 (local address 127.23.229.3:43845)
0809 18:59:16.159828 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.159833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.160710 (+ 877us) server_negotiation.cc:407] Connection header received
0809 18:59:16.160756 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.160759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.160775 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.160846 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:16.161008 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.161944 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.163231 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.163979 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.164054 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.164092 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.164221 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.164260 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":103,"threads_started":1}
I20260809 18:59:16.164723 15200 tablet_service.cc:1467] Processing CreateTablet for tablet 7b621d8328054bf8ab8ebecfe0883dfb (DEFAULT_TABLE table=test-table [id=e10c2f7d12b24f789bcaef9e59772d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:16.165154 15200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b621d8328054bf8ab8ebecfe0883dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:16.165187 15397 tablet_service.cc:1467] Processing CreateTablet for tablet 7b621d8328054bf8ab8ebecfe0883dfb (DEFAULT_TABLE table=test-table [id=e10c2f7d12b24f789bcaef9e59772d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:16.165519 15397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b621d8328054bf8ab8ebecfe0883dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:16.168804 15509 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Bootstrap starting.
I20260809 18:59:16.168989 15510 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Bootstrap starting.
I20260809 18:59:16.169641 15510 tablet_bootstrap.cc:654] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:16.169641 15509 tablet_bootstrap.cc:654] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:16.170279 15509 log.cc:824] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:16.170279 15510 log.cc:824] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:16.171177 15509 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: No bootstrap required, opened a new log
I20260809 18:59:16.171170 15510 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: No bootstrap required, opened a new log
I20260809 18:59:16.171248 15509 ts_tablet_manager.cc:1397] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:16.171248 15510 ts_tablet_manager.cc:1397] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:16.173296 15510 raft_consensus.cc:348] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.173296 15509 raft_consensus.cc:348] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.173475 15509 raft_consensus.cc:374] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:16.173475 15510 raft_consensus.cc:374] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:16.173521 15510 raft_consensus.cc:729] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d807ca268cae495bad2c95889c471196, State: Initialized, Role: FOLLOWER
I20260809 18:59:16.173514 15509 raft_consensus.cc:729] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21342ed1ca014e8b985b02c61add01b6, State: Initialized, Role: FOLLOWER
I20260809 18:59:16.173641 15510 consensus_queue.cc:260] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.173641 15509 consensus_queue.cc:260] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.173951 15510 ts_tablet_manager.cc:1428] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:59:16.173951 15509 ts_tablet_manager.cc:1428] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:16.174007 15310 heartbeater.cc:503] Master 127.23.229.62:43959 was elected leader, sending a full tablet report...
I20260809 18:59:16.174091 15494 heartbeater.cc:503] Master 127.23.229.62:43959 was elected leader, sending a full tablet report...
W20260809 18:59:16.225988 15311 tablet.cc:2369] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:16.274300 15516 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:16.274454 15516 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.274982 15516 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845), df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655)
I20260809 18:59:16.278049 15506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.275312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:53853 (local address 127.23.229.3:43845)
0809 18:59:16.275407 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.275409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.275432 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:59:16.275465 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.275466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.275475 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.275558 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:16.275732 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.276221 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.277254 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.277646 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.277738 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.277748 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.277940 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.277981 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:59:16.278048 15312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.275200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:43845 (local address 127.23.229.2:53853)
0809 18:59:16.275267 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.275280 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:16.275328 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:16.275567 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:16.275569 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:16.275571 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:16.275652 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.275654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.276314 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.276315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.277152 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.277154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.277736 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.277737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.277826 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.277829 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:59:16.277928 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 18:59:16.277975 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 18:59:16.278163 15097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.275309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:47765 (local address 127.23.229.1:34655)
0809 18:59:16.275354 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.275356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.275525 (+ 169us) server_negotiation.cc:407] Connection header received
0809 18:59:16.275589 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.275590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.275620 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.275700 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:16.275871 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.276382 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.277396 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.277809 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.277902 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.277997 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.278045 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.278083 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:59:16.278163 15518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.275229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34655 (local address 127.23.229.2:47765)
0809 18:59:16.275447 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.275456 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:16.275528 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:16.275719 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:16.275720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:16.275722 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:16.275800 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.275802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.276523 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.276524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.277297 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:16.277299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.277903 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.277904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:16.277975 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.277979 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:59:16.278037 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:59:16.278079 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":132,"threads_started":1}
I20260809 18:59:16.278483 15429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b621d8328054bf8ab8ebecfe0883dfb" candidate_uuid: "d807ca268cae495bad2c95889c471196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21342ed1ca014e8b985b02c61add01b6" is_pre_election: true
I20260809 18:59:16.278671 15429 raft_consensus.cc:2454] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d807ca268cae495bad2c95889c471196 in term 0.
I20260809 18:59:16.278734 15007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b621d8328054bf8ab8ebecfe0883dfb" candidate_uuid: "d807ca268cae495bad2c95889c471196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df008a4afb4c4089b95e90a46a8f7669" is_pre_election: true
I20260809 18:59:16.278923 15007 raft_consensus.cc:2454] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d807ca268cae495bad2c95889c471196 in term 0.
I20260809 18:59:16.279003 15124 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196; no voters:
I20260809 18:59:16.279146 15516 raft_consensus.cc:2781] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:16.279201 15516 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:16.279232 15516 raft_consensus.cc:3037] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:16.280004 15516 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.280170 15516 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [CANDIDATE]: Term 1 election: Requested vote from peers 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845), df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655)
I20260809 18:59:16.280324 15429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b621d8328054bf8ab8ebecfe0883dfb" candidate_uuid: "d807ca268cae495bad2c95889c471196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21342ed1ca014e8b985b02c61add01b6"
I20260809 18:59:16.280362 15007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b621d8328054bf8ab8ebecfe0883dfb" candidate_uuid: "d807ca268cae495bad2c95889c471196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df008a4afb4c4089b95e90a46a8f7669"
I20260809 18:59:16.280439 15429 raft_consensus.cc:3037] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:16.280435 15007 raft_consensus.cc:3037] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:16.281198 15007 raft_consensus.cc:2454] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d807ca268cae495bad2c95889c471196 in term 1.
I20260809 18:59:16.281167 15429 raft_consensus.cc:2454] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d807ca268cae495bad2c95889c471196 in term 1.
I20260809 18:59:16.281371 15124 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196; no voters:
I20260809 18:59:16.281466 15516 raft_consensus.cc:2781] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:16.281635 15516 raft_consensus.cc:686] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 1 LEADER]: Becoming Leader. State: Replica: d807ca268cae495bad2c95889c471196, State: Running, Role: LEADER
I20260809 18:59:16.281764 15516 consensus_queue.cc:237] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.282665 14788 catalog_manager.cc:5495] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 reported cstate change: term changed from 0 to 1, leader changed from <none> to d807ca268cae495bad2c95889c471196 (127.23.229.2). New cstate: current_term: 1 leader_uuid: "d807ca268cae495bad2c95889c471196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } health_report { overall_health: UNKNOWN } } }
I20260809 18:59:16.313341 15504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.310780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59828 (local address 127.23.229.2:45081)
0809 18:59:16.310864 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:16.310867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:16.310877 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:59:16.310923 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:16.310924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:16.310946 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:16.311015 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:16.311129 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.311629 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.312394 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:16.312662 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:16.312721 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:16.312884 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:16.313006 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:16.313073 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:16.313182 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 18:59:16.313200 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 18:59:16.315552 15429 raft_consensus.cc:1261] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 1 FOLLOWER]: Refusing update from remote peer d807ca268cae495bad2c95889c471196: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:16.315553 15007 raft_consensus.cc:1261] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Refusing update from remote peer d807ca268cae495bad2c95889c471196: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:16.315968 15520 consensus_queue.cc:1035] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:16.316134 15516 consensus_queue.cc:1035] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:16.318760 15527 mvcc.cc:205] Tried to move back new op lower bound from 7316692813065084928 to 7316692812930641920. Current Snapshot: MvccSnapshot[applied={T|T < 7316692813065084928}]
I20260809 18:59:16.319074 15529 mvcc.cc:205] Tried to move back new op lower bound from 7316692813065084928 to 7316692812930641920. Current Snapshot: MvccSnapshot[applied={T|T < 7316692813065084928}]
I20260809 18:59:16.320927 14787 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:41678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:16.321045 14787 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:41678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:16.321842 14787 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Sending DeleteTablet for 3 replicas of tablet 7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:16.322211 15200 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b621d8328054bf8ab8ebecfe0883dfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:16 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:59814
I20260809 18:59:16.322269 14977 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b621d8328054bf8ab8ebecfe0883dfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:16 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:59618
I20260809 18:59:16.322317 15397 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b621d8328054bf8ab8ebecfe0883dfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:16 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:57656
I20260809 18:59:16.322393 15098 tablet_replica.cc:330] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: stopping tablet replica
I20260809 18:59:16.322461 15098 raft_consensus.cc:2229] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:16.322521 15098 raft_consensus.cc:2258] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:16.322572 15539 tablet_replica.cc:330] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: stopping tablet replica
I20260809 18:59:16.322562 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 14854
I20260809 18:59:16.322674 15539 raft_consensus.cc:2229] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:16.328900 15539 raft_consensus.cc:2258] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:16.331331 15538 tablet_replica.cc:330] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: stopping tablet replica
I20260809 18:59:16.331455 15538 raft_consensus.cc:2229] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:59:16.331453 15539 ts_tablet_manager.cc:1905] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:16.331576 15538 raft_consensus.cc:2258] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:16.332041 15538 ts_tablet_manager.cc:1905] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:16.333631 15539 ts_tablet_manager.cc:1918] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:16.333722 15539 log.cc:1196] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:16.333832 15538 ts_tablet_manager.cc:1918] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:16.333906 15538 log.cc:1196] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:16.334076 15539 ts_tablet_manager.cc:1939] T 7b621d8328054bf8ab8ebecfe0883dfb P 21342ed1ca014e8b985b02c61add01b6: Deleting consensus metadata
I20260809 18:59:16.334196 15538 ts_tablet_manager.cc:1939] T 7b621d8328054bf8ab8ebecfe0883dfb P d807ca268cae495bad2c95889c471196: Deleting consensus metadata
I20260809 18:59:16.334656 14768 catalog_manager.cc:4841] TS d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): tablet 7b621d8328054bf8ab8ebecfe0883dfb (table test-table [id=e10c2f7d12b24f789bcaef9e59772d24]) successfully deleted
I20260809 18:59:16.336623 14766 catalog_manager.cc:4841] TS 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): tablet 7b621d8328054bf8ab8ebecfe0883dfb (table test-table [id=e10c2f7d12b24f789bcaef9e59772d24]) successfully deleted
W20260809 18:59:16.338668 14767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:34655 (error 108)
I20260809 18:59:16.338980 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 15093
I20260809 18:59:16.339272 15503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.339140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34655 (local address 127.0.0.1:59634)
0809 18:59:16.339196 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.339230 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:59:16.339392 14767 catalog_manager.cc:4584] TS df008a4afb4c4089b95e90a46a8f7669 (127.23.229.1:34655): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b621d8328054bf8ab8ebecfe0883dfb: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34655: connect: Connection refused (error 111)
I20260809 18:59:16.348906 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 15313
I20260809 18:59:16.365339 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 14740
I20260809 18:59:16.376664 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43959
--webserver_interface=127.23.229.62
--webserver_port=45681
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:16.461374 15544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:16.461591 15544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:16.461612 15544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:16.462754 15544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:16.462796 15544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:16.462810 15544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:16.462828 15544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:16.462883 15544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:16.464365 15544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=45681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:16.464656 15544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:16.464905 15544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:16.469849 15554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.469856 15552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:16.469961 15544 server_base.cc:1034] running on GCE node
W20260809 18:59:16.469866 15551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:16.470448 15544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:16.470783 15544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:16.471951 15544 hybrid_clock.cc:648] HybridClock initialized: now 1786301956471938 us; error 34 us; skew 500 ppm
Aug 09 18:59:16 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:16.474660 15544 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:16.475147 15544 webserver.cc:460] Webserver started at http://127.23.229.62:45681/ using document root <none> and password file <none>
I20260809 18:59:16.475339 15544 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:16.475380 15544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:16.476737 15544 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:16.477370 15563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.477555 15544 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:59:16.477669 15544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "bace1d74aa95caf31fdbdb10449b55ff"
server_key_iv: "04730e2195ca1ea252151d8dbabb751e"
server_key_version: "encryptionkey@0"
I20260809 18:59:16.478041 15544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:16.488797 15544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:16.490638 15544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:16.490820 15544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:16.495149 15544 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43959
I20260809 18:59:16.495183 15641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43959 every 8 connection(s)
I20260809 18:59:16.495590 15544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:16.497301 15642 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:59:16.498000 15642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Bootstrap starting.
I20260809 18:59:16.502264 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 15544
I20260809 18:59:16.502578 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:34655
--local_ip_for_outbound_sockets=127.23.229.1
--tserver_master_addrs=127.23.229.62:43959
--webserver_port=44391
--webserver_interface=127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:16.507720 15642 log.cc:824] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:16.510109 15642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:16.510456 15642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806: Bootstrap complete.
I20260809 18:59:16.513067 15642 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:16.513310 15642 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35cac94e0c454c6dbfd9c5f5c2dbe806, State: Initialized, Role: FOLLOWER
I20260809 18:59:16.513494 15642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:16.513567 15642 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:16.513629 15642 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:16.513679 15642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 2 FOLLOWER]: Advancing to term 3
I20260809 18:59:16.514758 15642 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:16.514876 15642 leader_election.cc:302] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35cac94e0c454c6dbfd9c5f5c2dbe806; no voters:
I20260809 18:59:16.515100 15642 leader_election.cc:288] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 18:59:16.515169 15646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 18:59:16.515318 15646 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [term 3 LEADER]: Becoming Leader. State: Replica: 35cac94e0c454c6dbfd9c5f5c2dbe806, State: Running, Role: LEADER
I20260809 18:59:16.515412 15642 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:16.515429 15646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } }
I20260809 18:59:16.515733 15646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35cac94e0c454c6dbfd9c5f5c2dbe806. Latest consensus state: current_term: 3 leader_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } } }
I20260809 18:59:16.515800 15646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:16.515982 15647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cac94e0c454c6dbfd9c5f5c2dbe806" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43959 } } }
I20260809 18:59:16.516048 15647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cac94e0c454c6dbfd9c5f5c2dbe806 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:16.516554 15652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:16.517554 15652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:16.517669 15652 catalog_manager.cc:1259] Loaded cluster ID: 04fa214787e849d78111c7161e6cdf33
I20260809 18:59:16.517710 15652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 18:59:16.518059 15652 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5b50d4d9ad google::LogMessage::Fail() at ??:0
@ 0x7f5b50d5088a google::LogMessage::SendToLog() at ??:0
@ 0x7f5b50d4d4de google::LogMessage::Flush() at ??:0
@ 0x7f5b50d4ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5b58c6e0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f5b58c778b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5b52c1b0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5b52c10954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5b53a746db start_thread at ??:0
@ 0x7f5b4f84b61f clone at ??:0
W20260809 18:59:16.621563 15644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:16.621773 15644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:16.621797 15644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:16.622956 15644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:16.622999 15644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:16.623026 15644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:59:16.624639 15644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:34655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=44391
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:16.624898 15644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:16.625144 15644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:16.630283 15690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.630323 15689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.630527 15692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:16.630597 15644 server_base.cc:1034] running on GCE node
I20260809 18:59:16.630841 15644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:16.631111 15644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:16.632264 15644 hybrid_clock.cc:648] HybridClock initialized: now 1786301956632261 us; error 47 us; skew 500 ppm
Aug 09 18:59:16 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:16.634976 15644 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:59:16.635504 15644 webserver.cc:460] Webserver started at http://127.23.229.1:44391/ using document root <none> and password file <none>
I20260809 18:59:16.635758 15644 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:16.635808 15644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:16.637287 15644 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:16.638053 15704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.638264 15644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:16.638365 15644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "df008a4afb4c4089b95e90a46a8f7669"
format_stamp: "Formatted at 2026-08-09 18:59:14 on dist-test-slave-jq4t"
server_key: "0fd5694ed411757e6020a8a637ec8f8b"
server_key_iv: "65d9f5fbc09ff4c921ab70ffa05c8683"
server_key_version: "encryptionkey@0"
I20260809 18:59:16.638747 15644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:16.652259 15644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:16.654812 15644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:16.655009 15644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:16.655261 15644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:16.655752 15714 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 18:59:16.657876 15644 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:59:16.657949 15644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 18:59:16.657995 15644 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:59:16.658818 15644 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:59:16.658871 15644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:16.659044 15714 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Bootstrap starting.
I20260809 18:59:16.666498 15644 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:34655
I20260809 18:59:16.666678 15890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:34655 every 8 connection(s)
I20260809 18:59:16.666972 15644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:16.669258 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 15644
I20260809 18:59:16.669551 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:45081
--local_ip_for_outbound_sockets=127.23.229.2
--tserver_master_addrs=127.23.229.62:43959
--webserver_port=45793
--webserver_interface=127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:16.670614 15714 log.cc:824] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:16.673802 15714 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:16.674157 15714 tablet_bootstrap.cc:492] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Bootstrap complete.
I20260809 18:59:16.675478 15714 ts_tablet_manager.cc:1397] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.004s
I20260809 18:59:16.677085 15714 raft_consensus.cc:348] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.677464 15714 raft_consensus.cc:729] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: df008a4afb4c4089b95e90a46a8f7669, State: Initialized, Role: FOLLOWER
I20260809 18:59:16.677663 15714 consensus_queue.cc:260] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:16.677969 15714 ts_tablet_manager.cc:1428] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260809 18:59:16.737718 15895 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:59:16.667721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:39311)
0809 18:59:16.667906 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.667961 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:16.668463 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:16.737490 (+ 69027us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":107,"threads_started":1}
W20260809 18:59:16.738059 15891 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:43959 (0 consecutive failures): Network error: Failed to ping master at 127.23.229.62:43959: Client connection negotiation failed: client connection to 127.23.229.62:43959: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 18:59:16.738472 15895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.738320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:45515)
0809 18:59:16.738387 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.738443 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:59:16.738901 15895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.738805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:44131)
0809 18:59:16.738852 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.738879 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 18:59:16.739048 15891 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:59:16.762610 15899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:16.762836 15899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:16.762862 15899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:16.763963 15899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:16.763998 15899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:16.764024 15899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:59:16.765558 15899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:45081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=45793
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:16.765771 15899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:16.765969 15899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:59:16.771385 15899 server_base.cc:1034] running on GCE node
W20260809 18:59:16.771377 15908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.771358 15911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.771335 15907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:16.771735 15899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:16.772027 15899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:16.773195 15899 hybrid_clock.cc:648] HybridClock initialized: now 1786301956773185 us; error 40 us; skew 500 ppm
Aug 09 18:59:16 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:16.775844 15899 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:59:16.776307 15899 webserver.cc:460] Webserver started at http://127.23.229.2:45793/ using document root <none> and password file <none>
I20260809 18:59:16.776599 15899 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:16.776671 15899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:16.778245 15899 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:59:16.778877 15924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.779105 15899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:59:16.779234 15899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "d807ca268cae495bad2c95889c471196"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "ba87fde7c03d863218fba6394d7f4a3a"
server_key_iv: "663325782e3ea0b65e3f2b0ab068a42e"
server_key_version: "encryptionkey@0"
I20260809 18:59:16.779610 15899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:16.807848 15899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:16.810585 15899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:16.810739 15899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:16.811053 15899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:16.811399 15899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:16.811436 15899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.811460 15899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:16.811506 15899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.817888 15899 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:45081
I20260809 18:59:16.817934 16099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:45081 every 8 connection(s)
I20260809 18:59:16.818305 15899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:16.819545 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.819120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:52577)
0809 18:59:16.819299 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.819383 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260809 18:59:16.819882 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 15899
W20260809 18:59:16.820024 16101 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:43959 (0 consecutive failures): Network error: Failed to ping master at 127.23.229.62:43959: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
I20260809 18:59:16.820181 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:43845
--local_ip_for_outbound_sockets=127.23.229.3
--tserver_master_addrs=127.23.229.62:43959
--webserver_port=34417
--webserver_interface=127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:16.820465 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.820267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:49111)
0809 18:59:16.820410 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.820442 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260809 18:59:16.820849 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.820764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:46155)
0809 18:59:16.820809 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.820832 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:59:16.820979 16101 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:59:16.907353 16105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:16.907577 16105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:16.907601 16105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:16.908879 16105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:16.908923 16105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:16.908950 16105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:59:16.910524 16105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:43845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=34417
--tserver_master_addrs=127.23.229.62:43959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:16.910794 16105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:16.911080 16105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:16.916563 16110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.916579 16116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:16.916574 16112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:16.916635 16105 server_base.cc:1034] running on GCE node
I20260809 18:59:16.917008 16105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:16.917289 16105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:16.918438 16105 hybrid_clock.cc:648] HybridClock initialized: now 1786301956918431 us; error 41 us; skew 500 ppm
Aug 09 18:59:16 dist-test-slave-jq4t krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:16.921075 16105 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:59:16.921484 16105 webserver.cc:460] Webserver started at http://127.23.229.3:34417/ using document root <none> and password file <none>
I20260809 18:59:16.921680 16105 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:16.921723 16105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:16.923013 16105 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 18:59:16.923570 16127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.923790 16105 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.923883 16105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "21342ed1ca014e8b985b02c61add01b6"
format_stamp: "Formatted at 2026-08-09 18:59:15 on dist-test-slave-jq4t"
server_key: "13431fbb85da52f437667969b3afc0c0"
server_key_iv: "ba66a11f378accad05302641fdd0f283"
server_key_version: "encryptionkey@0"
I20260809 18:59:16.924234 16105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:16.939383 16105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:16.941421 16105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:16.941541 16105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:16.941769 16105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:16.942111 16105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:16.942169 16105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.942212 16105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:16.942237 16105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:16.948168 16105 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:43845
I20260809 18:59:16.948282 16296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:43845 every 8 connection(s)
I20260809 18:59:16.948678 16105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:16.949815 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.949392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:42647)
0809 18:59:16.949573 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.949663 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":92,"threads_started":1}
W20260809 18:59:16.950243 16297 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:43959 (0 consecutive failures): Network error: Failed to ping master at 127.23.229.62:43959: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
I20260809 18:59:16.950573 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.950459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:38259)
0809 18:59:16.950515 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.950543 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:59:16.950879 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:16.950775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:34507)
0809 18:59:16.950832 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:16.950855 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 18:59:16.950997 16297 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:59:16.956382 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 16105
I20260809 18:59:17.739795 16303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:17.739521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:46941)
0809 18:59:17.739674 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:17.739720 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
I20260809 18:59:17.821605 16305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:17.821373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:38611)
0809 18:59:17.821505 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:17.821545 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260809 18:59:17.821780 16308 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:17.821924 16308 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:17.822230 16308 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d807ca268cae495bad2c95889c471196 (127.23.229.2:45081), 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
Aug 09 18:59:17 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.3@KRBTEST.COM
Aug 09 18:59:17 dist-test-slave-jq4t krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301956, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.2@KRBTEST.COM
I20260809 18:59:17.833495 16310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:17.822513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:46871 (local address 127.23.229.2:45081)
0809 18:59:17.822662 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:17.822674 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:17.822707 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:59:17.823171 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:17.823173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:17.823222 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:17.823393 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:17.824175 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.825113 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.826284 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.826685 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.826815 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:17.829809 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:17.829814 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:17.829814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:17.829826 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:17.831684 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:17.832108 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:17.832111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:17.832112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:17.832217 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:17.832537 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:17.832538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:17.832538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:17.832800 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:17.832895 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:17.833215 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 18:59:17.833354 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":53,"threads_started":1}
I20260809 18:59:17.833473 16303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:17.822404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:45081 (local address 127.23.229.1:46871)
0809 18:59:17.822475 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:17.822491 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:17.822561 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:17.823439 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:17.823442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:17.823846 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:17.824045 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:17.824051 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.825233 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.825234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:17.826186 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:17.826188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.826788 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.826789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:17.826911 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:17.827571 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:17.827579 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:17.829709 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:17.831760 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:17.831761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:17.831761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:17.832011 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:17.832292 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:17.832293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:17.832294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:17.832424 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:17.832886 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:17.832894 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:17.833034 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 18:59:17.833147 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 18:59:17.833367 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":24}
I20260809 18:59:17.833496 16312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:17.822545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:57633 (local address 127.23.229.3:43845)
0809 18:59:17.822700 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:17.822711 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:17.822738 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:59:17.823148 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:17.823151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:17.823213 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:17.823341 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:17.824187 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.825143 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.826272 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.826690 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.826880 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:17.829489 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:17.829494 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:17.829494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:17.829509 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:17.831592 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:17.832117 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:17.832120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:17.832120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:17.832229 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:17.832523 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:17.832524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:17.832524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:17.832801 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:17.832941 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:17.833219 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 18:59:17.833365 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260809 18:59:17.833596 16311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:17.822404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:43845 (local address 127.23.229.1:57633)
0809 18:59:17.822631 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:17.822641 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:17.822701 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:17.823465 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:17.823466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:17.823845 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:17.824045 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:17.824051 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.825245 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.825247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:17.826184 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:17.826187 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:17.826839 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:17.826840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:17.826917 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:17.827630 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:17.827635 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:17.829328 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:17.831695 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:17.831704 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:17.831706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:17.832003 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:17.832316 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:17.832317 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:17.832317 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:17.832427 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:17.832922 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:17.832923 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:17.833038 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 18:59:17.833147 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 18:59:17.833462 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":337,"thread_start_us":54,"threads_started":1}
W20260809 18:59:17.834519 15705 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
W20260809 18:59:17.835039 15707 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:17.835103 15707 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df008a4afb4c4089b95e90a46a8f7669; no voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196
I20260809 18:59:17.835274 16308 raft_consensus.cc:2726] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:17.951673 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:17.951381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:51401)
0809 18:59:17.951569 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:17.951626 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":93,"threads_started":1}
I20260809 18:59:18.740705 16314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:18.740400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:35463)
0809 18:59:18.740611 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:18.740653 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":123,"threads_started":1}
I20260809 18:59:18.822310 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:18.822117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:37795)
0809 18:59:18.822239 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:18.822268 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":63,"threads_started":1}
I20260809 18:59:18.952657 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:18.952221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:44111)
0809 18:59:18.952404 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:18.952446 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260809 18:59:19.686503 16321 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:19.686614 16321 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:19.686770 16321 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d807ca268cae495bad2c95889c471196 (127.23.229.2:45081), 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
W20260809 18:59:19.687275 15707 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
W20260809 18:59:19.687424 15705 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:19.687525 15705 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df008a4afb4c4089b95e90a46a8f7669; no voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196
I20260809 18:59:19.687619 16321 raft_consensus.cc:2726] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:19.741660 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:19.741404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:34695)
0809 18:59:19.741556 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:19.741605 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260809 18:59:19.823241 16325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:19.822907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:43649)
0809 18:59:19.823118 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:19.823169 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":121,"threads_started":1}
I20260809 18:59:19.953440 16326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:19.953156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:42039)
0809 18:59:19.953332 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:19.953384 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":89,"threads_started":1}
I20260809 18:59:20.742445 16327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:20.742218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:34051)
0809 18:59:20.742352 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:20.742392 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260809 18:59:20.824137 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:20.823891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:53165)
0809 18:59:20.824039 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:20.824085 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260809 18:59:20.954276 16329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:20.954000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:44765)
0809 18:59:20.954180 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:20.954224 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":69,"threads_started":1}
I20260809 18:59:21.269835 16330 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:21.269948 16330 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:21.270197 16330 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d807ca268cae495bad2c95889c471196 (127.23.229.2:45081), 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
W20260809 18:59:21.270633 15707 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
W20260809 18:59:21.270756 15705 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:21.270856 15705 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df008a4afb4c4089b95e90a46a8f7669; no voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196
I20260809 18:59:21.270956 16330 raft_consensus.cc:2726] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:21.743296 16332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.743052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:58307)
0809 18:59:21.743201 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:21.743243 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
I20260809 18:59:21.824853 16333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.824627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:37151)
0809 18:59:21.824761 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:21.824804 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260809 18:59:21.955140 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.954841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:33625)
0809 18:59:21.955002 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:21.955055 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":79,"threads_started":1}
I20260809 18:59:22.744083 16335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:22.743847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:37877)
0809 18:59:22.743993 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:22.744029 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260809 18:59:22.825700 16340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:22.825416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:58821)
0809 18:59:22.825601 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:22.825648 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":104,"threads_started":1}
I20260809 18:59:22.956023 16343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:22.955712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:46375)
0809 18:59:22.955923 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:22.955968 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":96,"threads_started":1}
I20260809 18:59:23.744891 16344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:23.744668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:38049)
0809 18:59:23.744799 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:23.744839 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260809 18:59:23.826525 16347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:23.826222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:39677)
0809 18:59:23.826431 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:23.826474 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":66,"threads_started":1}
I20260809 18:59:23.956988 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:23.956724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:53501)
0809 18:59:23.956879 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:23.956928 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260809 18:59:24.343312 16349 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:24.343544 16349 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:24.343775 16349 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d807ca268cae495bad2c95889c471196 (127.23.229.2:45081), 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
W20260809 18:59:24.344219 15707 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
W20260809 18:59:24.344295 15705 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:24.344367 15705 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df008a4afb4c4089b95e90a46a8f7669; no voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196
I20260809 18:59:24.344462 16349 raft_consensus.cc:2726] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:24.745712 16351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.745458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:49015)
0809 18:59:24.745616 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:24.745656 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":68,"threads_started":1}
I20260809 18:59:24.827426 16352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.827131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:55685)
0809 18:59:24.827318 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:24.827362 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":113,"threads_started":1}
I20260809 18:59:24.957733 16353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.957522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:57459)
0809 18:59:24.957649 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:24.957683 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260809 18:59:25.746507 16354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.746238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:33607)
0809 18:59:25.746400 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.746444 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260809 18:59:25.828123 16355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.827892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:39469)
0809 18:59:25.828035 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.828075 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260809 18:59:25.958698 16356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.958426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:43027)
0809 18:59:25.958592 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.958644 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":74,"threads_started":1}
I20260809 18:59:26.747311 16357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:26.747071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:57129)
0809 18:59:26.747212 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:26.747257 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260809 18:59:26.828882 16358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:26.828657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:46903)
0809 18:59:26.828789 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:26.828830 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260809 18:59:26.959597 16360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:26.959344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:41919)
0809 18:59:26.959495 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:26.959542 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":74,"threads_started":1}
I20260809 18:59:27.111768 16361 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:27.111881 16361 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:27.112066 16361 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d807ca268cae495bad2c95889c471196 (127.23.229.2:45081), 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
W20260809 18:59:27.112526 15707 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
W20260809 18:59:27.112607 15705 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:27.112660 15705 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df008a4afb4c4089b95e90a46a8f7669; no voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196
I20260809 18:59:27.112732 16361 raft_consensus.cc:2726] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:27.748220 16363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:27.747957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:53385)
0809 18:59:27.748120 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:27.748166 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260809 18:59:27.829622 16365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:27.829390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:50041)
0809 18:59:27.829527 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:27.829569 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260809 18:59:27.960557 16367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:27.960257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:48193)
0809 18:59:27.960401 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:27.960435 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260809 18:59:28.749037 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.748776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:53279)
0809 18:59:28.748940 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.748983 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":75,"threads_started":1}
I20260809 18:59:28.830435 16369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.830175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:54845)
0809 18:59:28.830330 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.830383 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260809 18:59:28.961354 16370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.961100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:47637)
0809 18:59:28.961248 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.961290 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260809 18:59:29.069223 16371 raft_consensus.cc:482] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:29.069334 16371 raft_consensus.cc:504] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d807ca268cae495bad2c95889c471196" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45081 } } peers { permanent_uuid: "21342ed1ca014e8b985b02c61add01b6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 43845 } } peers { permanent_uuid: "df008a4afb4c4089b95e90a46a8f7669" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34655 } }
I20260809 18:59:29.069532 16371 leader_election.cc:288] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d807ca268cae495bad2c95889c471196 (127.23.229.2:45081), 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845)
W20260809 18:59:29.070001 15707 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d807ca268cae495bad2c95889c471196 (127.23.229.2:45081): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
W20260809 18:59:29.070091 15705 leader_election.cc:341] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21342ed1ca014e8b985b02c61add01b6 (127.23.229.3:43845): Not found: Tablet not found: 7b621d8328054bf8ab8ebecfe0883dfb
I20260809 18:59:29.070137 15705 leader_election.cc:302] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df008a4afb4c4089b95e90a46a8f7669; no voters: 21342ed1ca014e8b985b02c61add01b6, d807ca268cae495bad2c95889c471196
I20260809 18:59:29.070232 16371 raft_consensus.cc:2726] T 7b621d8328054bf8ab8ebecfe0883dfb P df008a4afb4c4089b95e90a46a8f7669 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:29.749922 16372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.749637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:35617)
0809 18:59:29.749816 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.749865 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":77,"threads_started":1}
I20260809 18:59:29.831233 16374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.830963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:59765)
0809 18:59:29.831138 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.831180 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":80,"threads_started":1}
I20260809 18:59:29.962241 16375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.961961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:38833)
0809 18:59:29.962135 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.962186 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":78,"threads_started":1}
I20260809 18:59:30.750741 16377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:30.750494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:46741)
0809 18:59:30.750645 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:30.750689 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":75,"threads_started":1}
I20260809 18:59:30.831902 16381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:30.831666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:56047)
0809 18:59:30.831811 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:30.831850 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260809 18:59:30.963189 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:30.962875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:52815)
0809 18:59:30.963068 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:30.963118 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":75,"threads_started":1}
I20260809 18:59:31.751600 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:31.751379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.1:40673)
0809 18:59:31.751510 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:31.751549 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260809 18:59:31.832829 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:31.832571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.2:49189)
0809 18:59:31.832741 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:31.832775 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":112,"threads_started":1}
I20260809 18:59:31.959722 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 15644
I20260809 18:59:31.966414 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:31.966160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43959 (local address 127.23.229.3:47781)
0809 18:59:31.966308 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:31.966349 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:43959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260809 18:59:31.971969 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 15899
I20260809 18:59:31.983742 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 16105
2026-08-09T18:59:31Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18681 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:32 dist-test-slave-jq4t krb5kdc[16398](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:32 dist-test-slave-jq4t krb5kdc[16398](info): set up 2 sockets
Aug 09 18:59:32 dist-test-slave-jq4t krb5kdc[16398](info): commencing operation
krb5kdc: starting...
W20260809 18:59:33.236264 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:59:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:59:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 18:59:33.363653 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42935
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:33.452205 16419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:33.452462 16419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:33.452528 16419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:33.453706 16419 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 18:59:33.453778 16419 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 18:59:33.453800 16419 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 18:59:33.453819 16419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:33.453852 16419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:33.453905 16419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:33.453933 16419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:33.453961 16419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:33.455554 16419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:33.455888 16419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:33.456149 16419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:33.461519 16426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.461535 16424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:33.461711 16419 server_base.cc:1034] running on GCE node
W20260809 18:59:33.461510 16431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:33.462070 16419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:33.462478 16419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:33.463645 16419 hybrid_clock.cc:648] HybridClock initialized: now 1786301973463633 us; error 29 us; skew 500 ppm
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:33.466321 16419 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:33.466825 16419 webserver.cc:460] Webserver started at http://127.23.229.62:44875/ using document root <none> and password file <none>
I20260809 18:59:33.467087 16419 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:33.467165 16419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:33.467319 16419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:33.468408 16419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "fdebca6086424130b305308b4b9552aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "072eacbd62b7104fa99a30194b9d5146"
server_key_iv: "334e731f0f7abef6167db9c7db6bd8c7"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.468843 16419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "fdebca6086424130b305308b4b9552aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "072eacbd62b7104fa99a30194b9d5146"
server_key_iv: "334e731f0f7abef6167db9c7db6bd8c7"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.470198 16419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:33.470957 16440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.471138 16419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:59:33.471249 16419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "fdebca6086424130b305308b4b9552aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "072eacbd62b7104fa99a30194b9d5146"
server_key_iv: "334e731f0f7abef6167db9c7db6bd8c7"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.471328 16419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:33.486306 16419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:33.488258 16419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:33.488454 16419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:33.492982 16419 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:42935
I20260809 18:59:33.493034 16517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:42935 every 8 connection(s)
I20260809 18:59:33.493424 16419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:33.494412 16518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:33.496809 16518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Bootstrap starting.
I20260809 18:59:33.497380 16518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:33.497663 16518 log.cc:824] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:33.498324 16518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: No bootstrap required, opened a new log
I20260809 18:59:33.499958 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 16419
I20260809 18:59:33.500077 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 18:59:33.500051 16518 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:33.500238 16518 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:33.500276 16518 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdebca6086424130b305308b4b9552aa, State: Initialized, Role: FOLLOWER
I20260809 18:59:33.500300 24468 external_mini_cluster.cc:1428] Setting key 2d048697489d3a6583b01a3361b77b6c
I20260809 18:59:33.500428 16518 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:33.500560 16518 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:33.500612 16518 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:33.500663 16518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:33.501824 16518 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:33.501956 16518 leader_election.cc:302] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdebca6086424130b305308b4b9552aa; no voters:
I20260809 18:59:33.502162 16518 leader_election.cc:288] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:59:33.502252 16526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:33.502419 16526 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 LEADER]: Becoming Leader. State: Replica: fdebca6086424130b305308b4b9552aa, State: Running, Role: LEADER
I20260809 18:59:33.502485 16518 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:33.502550 16526 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:33.502970 16526 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdebca6086424130b305308b4b9552aa. Latest consensus state: current_term: 1 leader_uuid: "fdebca6086424130b305308b4b9552aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } } }
I20260809 18:59:33.502978 16527 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdebca6086424130b305308b4b9552aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } } }
I20260809 18:59:33.503152 16526 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:33.503158 16527 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:33.503400 16537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:33.504164 16537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:33.505749 16537 catalog_manager.cc:1347] Generated new cluster ID: 8c47fb5ac20e45e887473906fd322649
I20260809 18:59:33.505812 16537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:33.512238 16525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.500877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55008 (local address 127.23.229.62:42935)
0809 18:59:33.501060 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:33.501069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:33.501107 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:59:33.501214 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:33.501219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:33.501261 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:33.501380 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:33.502322 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.503888 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.504984 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.505596 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.506056 (+ 460us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:33.508249 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:33.508254 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:33.508254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:33.508267 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:33.510306 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.510692 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.510695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.510696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.510826 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.511018 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.511019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.511019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.511304 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:33.511836 (+ 532us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:33.511906 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 18:59:33.512037 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260809 18:59:33.515599 16537 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:33.516331 16537 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:33.519902 16537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Generated new TSK 0
I20260809 18:59:33.520174 16537 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 18:59:33.547359 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42935
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:33.634013 16557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:33.634258 16557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:33.634297 16557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:33.635450 16557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:33.635525 16557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:33.635569 16557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:59:33.637152 16557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:33.637449 16557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:33.637707 16557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:33.643186 16567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.643208 16564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.643200 16565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:33.643257 16557 server_base.cc:1034] running on GCE node
I20260809 18:59:33.643563 16557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:33.643859 16557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:33.645030 16557 hybrid_clock.cc:648] HybridClock initialized: now 1786301973645013 us; error 33 us; skew 500 ppm
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:33.647701 16557 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:59:33.648113 16557 webserver.cc:460] Webserver started at http://127.23.229.1:43591/ using document root <none> and password file <none>
I20260809 18:59:33.648350 16557 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:33.648398 16557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:33.648573 16557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:33.649683 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "14ae486f98ce4290a37e25c4f361c196"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "2ea15a07bc2a8256b31cc4abefe23a68"
server_key_iv: "2c1241a44c7dd2facd2bba12500530af"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.650066 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "14ae486f98ce4290a37e25c4f361c196"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "2ea15a07bc2a8256b31cc4abefe23a68"
server_key_iv: "2c1241a44c7dd2facd2bba12500530af"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.651513 16557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:59:33.652305 16578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.652526 16557 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:33.652621 16557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "14ae486f98ce4290a37e25c4f361c196"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "2ea15a07bc2a8256b31cc4abefe23a68"
server_key_iv: "2c1241a44c7dd2facd2bba12500530af"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.652678 16557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:33.671976 16557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:33.674479 16557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:33.674609 16557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:33.674883 16557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:33.675227 16557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:33.675278 16557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.675303 16557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:33.675315 16557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.681464 16557 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:42739
I20260809 18:59:33.681557 16746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:42739 every 8 connection(s)
I20260809 18:59:33.681928 16557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:33.683401 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 16557
I20260809 18:59:33.683525 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 18:59:33.683735 24468 external_mini_cluster.cc:1428] Setting key 048b702d9600a87c9936ee81c5c81042
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:33.692731 16525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.682777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:33587 (local address 127.23.229.62:42935)
0809 18:59:33.682853 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:33.682855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:33.683080 (+ 225us) server_negotiation.cc:407] Connection header received
0809 18:59:33.683608 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:33.683609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:33.683627 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:33.683694 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:33.685067 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.685591 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.686649 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.686874 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.686965 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:33.689349 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:33.689358 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:33.689358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:33.689371 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:33.691191 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.691640 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.691641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.691642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.691711 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.691973 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.691974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.691975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.692136 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:33.692217 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:33.692473 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 18:59:33.692603 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:59:33.692836 16752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.682759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:33587)
0809 18:59:33.682946 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:33.682987 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:33.683487 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:33.683775 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:33.683779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:33.684718 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:33.684959 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:33.684965 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.685708 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.685709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:33.686549 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:33.686551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.686983 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.686984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:33.687129 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:33.687717 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:33.687727 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:33.689249 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:33.691291 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:33.691298 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:33.691300 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:33.691552 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:33.691784 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:33.691785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:33.691785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:33.691898 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:33.692208 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:33.692212 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:33.692333 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 18:59:33.692417 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 18:59:33.692634 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260809 18:59:33.693392 16750 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42935
I20260809 18:59:33.693488 16750 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:33.693691 16750 heartbeater.cc:511] Master 127.23.229.62:42935 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 18:59:33.694290 16461 ts_manager.cc:194] Registered new tserver with Master: 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1:42739)
I20260809 18:59:33.695148 16461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:33587
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 18:59:33.711817 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42935
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:33.798110 16756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:33.798358 16756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:33.798384 16756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:33.799613 16756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:33.799662 16756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:33.799690 16756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:59:33.801292 16756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:33.801560 16756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:33.801820 16756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:33.807272 16763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.807281 16768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.807281 16765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:33.807621 16756 server_base.cc:1034] running on GCE node
I20260809 18:59:33.807829 16756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:33.808084 16756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:33.809254 16756 hybrid_clock.cc:648] HybridClock initialized: now 1786301973809240 us; error 27 us; skew 500 ppm
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:33.811836 16756 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:59:33.812325 16756 webserver.cc:460] Webserver started at http://127.23.229.2:41929/ using document root <none> and password file <none>
I20260809 18:59:33.812620 16756 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:33.812691 16756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:33.812834 16756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:33.813907 16756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "214c709c0e7f4f3390bcc209eea4b5aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "d6618ae47197ce9546a76d6600aaa886"
server_key_iv: "1c496d65be71cf8cb0f569103298b528"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.814301 16756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "214c709c0e7f4f3390bcc209eea4b5aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "d6618ae47197ce9546a76d6600aaa886"
server_key_iv: "1c496d65be71cf8cb0f569103298b528"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.815675 16756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:59:33.816408 16778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.816610 16756 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:59:33.816727 16756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "214c709c0e7f4f3390bcc209eea4b5aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "d6618ae47197ce9546a76d6600aaa886"
server_key_iv: "1c496d65be71cf8cb0f569103298b528"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.816804 16756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:33.831895 16756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:33.833894 16756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:33.834075 16756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:33.834332 16756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:33.834692 16756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:33.834751 16756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.834789 16756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:33.834836 16756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.841217 16756 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:41457
I20260809 18:59:33.841266 16954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:41457 every 8 connection(s)
I20260809 18:59:33.841629 16756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:33.847940 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 16756
I20260809 18:59:33.848043 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:33.848294 24468 external_mini_cluster.cc:1428] Setting key fc4ba0ce5bbde4bf6c8d474c2a8082ac
I20260809 18:59:33.851728 16525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.842452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43581 (local address 127.23.229.62:42935)
0809 18:59:33.842522 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:33.842525 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:33.842737 (+ 212us) server_negotiation.cc:407] Connection header received
0809 18:59:33.843250 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:33.843251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:33.843260 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:33.843322 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:33.844318 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.844988 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.846024 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.846218 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.846272 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:33.848703 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:33.848705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:33.848705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:33.848713 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:33.850272 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.850706 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.850707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.850708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.850775 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.851044 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.851045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.851046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.851172 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:33.851250 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:33.851545 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 18:59:33.851636 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:59:33.851933 16957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.842423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:43581)
0809 18:59:33.842600 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:33.842645 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:33.843163 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:33.843379 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:33.843382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:33.843999 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:33.844205 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:33.844210 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.845078 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.845079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:33.845939 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:33.845941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.846294 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.846295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:33.846402 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:33.847000 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:33.847009 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:33.848601 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:33.850379 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:33.850387 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:33.850389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:33.850623 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:33.850846 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:33.850847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:33.850847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:33.850967 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:33.851240 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:33.851248 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:33.851396 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 18:59:33.851511 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 18:59:33.851683 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260809 18:59:33.852517 16955 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42935
I20260809 18:59:33.852645 16955 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:33.852843 16955 heartbeater.cc:511] Master 127.23.229.62:42935 requested a full tablet report, sending...
I20260809 18:59:33.853296 16461 ts_manager.cc:194] Registered new tserver with Master: 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457)
I20260809 18:59:33.853716 16461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:43581
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 18:59:33.875110 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42935
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:33.961195 16960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:33.961444 16960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:33.961483 16960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:33.962610 16960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:33.962682 16960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:33.962723 16960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:59:33.964251 16960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:33.964567 16960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:33.964824 16960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:33.969871 16972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.969878 16974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.969987 16977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:33.970232 16960 server_base.cc:1034] running on GCE node
I20260809 18:59:33.970440 16960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:33.970695 16960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:33.971855 16960 hybrid_clock.cc:648] HybridClock initialized: now 1786301973971838 us; error 29 us; skew 500 ppm
Aug 09 18:59:33 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:33.974526 16960 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:59:33.974965 16960 webserver.cc:460] Webserver started at http://127.23.229.3:35325/ using document root <none> and password file <none>
I20260809 18:59:33.975165 16960 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:33.975206 16960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:33.975298 16960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:33.976296 16960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "f759f6654f3eb5f789ff5e16fdd232b9"
server_key_iv: "4417c6eb49cdcdcabee179dfe1a80215"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.976696 16960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "f759f6654f3eb5f789ff5e16fdd232b9"
server_key_iv: "4417c6eb49cdcdcabee179dfe1a80215"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.978047 16960 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:59:33.978762 16985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.978965 16960 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:59:33.979063 16960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "f759f6654f3eb5f789ff5e16fdd232b9"
server_key_iv: "4417c6eb49cdcdcabee179dfe1a80215"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.979120 16960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:33.987262 16960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:33.989588 16960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:33.989759 16960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:33.990005 16960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:33.990338 16960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:33.990373 16960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.990396 16960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:33.990442 16960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.996873 16960 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:34031
I20260809 18:59:33.997368 16960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:33.997637 17157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:34031 every 8 connection(s)
I20260809 18:59:34.001217 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 16960
I20260809 18:59:34.001350 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 18:59:34.001578 24468 external_mini_cluster.cc:1428] Setting key dd73dc4f65149fdda3d5743cd7f81893
Aug 09 18:59:34 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:34.008543 16525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.998580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:48115 (local address 127.23.229.62:42935)
0809 18:59:33.998631 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:33.998633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:33.998646 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:59:33.999282 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:33.999284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:33.999296 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:33.999366 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:34.000549 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.001074 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.002724 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.003036 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.003111 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.005590 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:34.005592 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:34.005593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:34.005600 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:34.007101 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:34.007549 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:34.007550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:34.007550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:34.007604 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:34.007898 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:34.007899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:34.007899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:34.008015 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:34.008066 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.008343 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.008413 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:59:34.008752 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.998246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:48115)
0809 18:59:33.998428 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:33.998478 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:33.999144 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:33.999450 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:33.999455 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:34.000185 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:34.000400 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.000405 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.001200 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.001201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.002635 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.002639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.003131 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.003132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.003247 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.003871 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:34.003879 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:34.005497 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:34.007200 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:34.007208 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:34.007210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:34.007458 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:34.007685 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:34.007686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:34.007686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:34.007825 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:34.008076 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:34.008081 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:34.008225 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 18:59:34.008317 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 18:59:34.008452 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260809 18:59:34.009294 17158 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42935
I20260809 18:59:34.009408 17158 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:34.009606 17158 heartbeater.cc:511] Master 127.23.229.62:42935 requested a full tablet report, sending...
I20260809 18:59:34.010033 16461 ts_manager.cc:194] Registered new tserver with Master: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
I20260809 18:59:34.010401 16461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:48115
I20260809 18:59:34.013600 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:34.021515 16525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.014974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.23.229.62:42935)
0809 18:59:34.015039 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:34.015041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:34.015181 (+ 140us) server_negotiation.cc:407] Connection header received
0809 18:59:34.015216 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:34.015216 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:34.015226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:34.015265 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:34.015781 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.016267 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.017068 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.017256 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.017309 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.018514 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:34.018515 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:34.018516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:34.018522 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:34.020161 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:34.020624 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:34.020626 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:34.020626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:34.020693 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:34.020930 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:34.020930 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:34.020931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:34.021094 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:34.021175 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.021344 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.021410 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:59:34.023224 16461 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:34.024976 16461 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:59:34.032199 17181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.028086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36834 (local address 127.23.229.1:42739)
0809 18:59:34.028269 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:34.028274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:34.028645 (+ 371us) server_negotiation.cc:407] Connection header received
0809 18:59:34.028694 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:34.028697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:34.028713 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:34.028795 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:34.028947 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.030018 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.031222 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.031738 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.031841 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.031914 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.032072 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.032113 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260809 18:59:34.032191 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.027673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:41457 (local address 127.0.0.1:49712)
0809 18:59:34.028011 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:34.028022 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:34.028092 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:34.028391 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:34.028394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:34.028397 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:34.028520 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.028523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.029624 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.029625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.030889 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.030892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.031856 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.031857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.031944 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.031949 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:59:34.032012 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 18:59:34.032075 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":96,"threads_started":1}
I20260809 18:59:34.032408 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.027629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:34031 (local address 127.0.0.1:35870)
0809 18:59:34.027954 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:34.028000 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:34.028087 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:34.028605 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:34.028606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:34.028608 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:34.028645 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.028646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.029996 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.029997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.031196 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.031199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.032142 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.032143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.032215 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.032219 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:59:34.032269 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 18:59:34.032313 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":95,"threads_started":1}
I20260809 18:59:34.032640 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.027820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49712 (local address 127.23.229.2:41457)
0809 18:59:34.028222 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:34.028227 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:34.028238 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:34.028282 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:34.028284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:34.028300 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:34.028393 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:34.028600 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.029508 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.031001 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.031744 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.032153 (+ 409us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.032221 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.032407 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.032563 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":84,"threads_started":1}
I20260809 18:59:34.032702 17177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.027754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35870 (local address 127.23.229.3:34031)
0809 18:59:34.027910 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:34.027915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:34.028188 (+ 273us) server_negotiation.cc:407] Connection header received
0809 18:59:34.028239 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:34.028242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:34.028262 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:34.028337 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:34.028728 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.029885 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.031270 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.031984 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.032050 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.032107 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.032568 (+ 461us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.032613 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260809 18:59:34.032899 17180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.027899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42739 (local address 127.0.0.1:36834)
0809 18:59:34.028525 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:34.028536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:34.028585 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:34.028810 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:34.028811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:34.028813 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:34.028856 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.028857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.030132 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.030134 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.031130 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.031133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.031845 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.031846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.031926 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.031942 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 18:59:34.032050 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 18:59:34.032095 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":118,"thread_start_us":88,"threads_started":1}
I20260809 18:59:34.033581 16852 tablet_service.cc:1467] Processing CreateTablet for tablet 1805f450a0504827acca5e287418e645 (DEFAULT_TABLE table=test-table [id=b4d03417b24b470991d558eec911874e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:34.033613 16641 tablet_service.cc:1467] Processing CreateTablet for tablet 1805f450a0504827acca5e287418e645 (DEFAULT_TABLE table=test-table [id=b4d03417b24b470991d558eec911874e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:34.033612 17058 tablet_service.cc:1467] Processing CreateTablet for tablet 1805f450a0504827acca5e287418e645 (DEFAULT_TABLE table=test-table [id=b4d03417b24b470991d558eec911874e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:34.033972 16852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1805f450a0504827acca5e287418e645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:34.033972 17058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1805f450a0504827acca5e287418e645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:34.033972 16641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1805f450a0504827acca5e287418e645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:34.036880 17184 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Bootstrap starting.
I20260809 18:59:34.037609 17184 tablet_bootstrap.cc:654] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:34.037583 17185 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Bootstrap starting.
I20260809 18:59:34.037849 17186 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Bootstrap starting.
I20260809 18:59:34.038234 17184 log.cc:824] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:34.038425 17186 tablet_bootstrap.cc:654] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:34.038511 17185 tablet_bootstrap.cc:654] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:34.039021 17185 log.cc:824] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:34.039116 17186 log.cc:824] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:34.039686 17184 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: No bootstrap required, opened a new log
I20260809 18:59:34.039770 17184 ts_tablet_manager.cc:1397] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:34.039896 17186 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: No bootstrap required, opened a new log
I20260809 18:59:34.039986 17185 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: No bootstrap required, opened a new log
I20260809 18:59:34.039999 17186 ts_tablet_manager.cc:1397] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:34.040050 17185 ts_tablet_manager.cc:1397] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:34.041509 17186 raft_consensus.cc:348] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.041687 17186 raft_consensus.cc:374] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:34.041734 17186 raft_consensus.cc:729] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, State: Initialized, Role: FOLLOWER
I20260809 18:59:34.041859 17186 consensus_queue.cc:260] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.041922 17184 raft_consensus.cc:348] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.042114 17184 raft_consensus.cc:374] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:34.042050 17185 raft_consensus.cc:348] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.042165 17184 raft_consensus.cc:729] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 214c709c0e7f4f3390bcc209eea4b5aa, State: Initialized, Role: FOLLOWER
I20260809 18:59:34.042192 17186 ts_tablet_manager.cc:1428] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:34.042210 17185 raft_consensus.cc:374] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:34.042246 17185 raft_consensus.cc:729] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ae486f98ce4290a37e25c4f361c196, State: Initialized, Role: FOLLOWER
I20260809 18:59:34.042331 17158 heartbeater.cc:503] Master 127.23.229.62:42935 was elected leader, sending a full tablet report...
I20260809 18:59:34.042310 17184 consensus_queue.cc:260] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.042374 17185 consensus_queue.cc:260] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.042599 17184 ts_tablet_manager.cc:1428] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:34.042635 17185 ts_tablet_manager.cc:1428] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:34.042737 16750 heartbeater.cc:503] Master 127.23.229.62:42935 was elected leader, sending a full tablet report...
I20260809 18:59:34.042781 16955 heartbeater.cc:503] Master 127.23.229.62:42935 was elected leader, sending a full tablet report...
W20260809 18:59:34.092259 16956 tablet.cc:2369] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:59:34.182802 16751 tablet.cc:2369] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:34.191620 17192 raft_consensus.cc:482] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:34.191761 17192 raft_consensus.cc:504] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.192108 17192 leader_election.cc:288] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1:42739), 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457)
I20260809 18:59:34.195320 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.192515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:55143 (local address 127.23.229.2:41457)
0809 18:59:34.192567 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:34.192569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:34.192584 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:59:34.192621 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:34.192622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:34.192634 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:34.192730 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:34.192936 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.193518 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.194556 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.194960 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.195053 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.195062 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.195211 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.195250 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:59:34.195310 17181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.192599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:42167 (local address 127.23.229.1:42739)
0809 18:59:34.192661 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:34.192663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:34.192676 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:59:34.192747 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:34.192750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:34.192764 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:34.192831 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:34.193027 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.193511 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.194570 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.194938 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.195027 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.195037 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.195184 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.195222 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:59:34.195336 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.192363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:41457 (local address 127.23.229.3:55143)
0809 18:59:34.192437 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:34.192451 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:34.192540 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:34.192755 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:34.192757 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:34.192759 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:34.192842 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.192844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.193620 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.193621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.194456 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.194459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.195050 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.195051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.195133 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.195136 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:59:34.195205 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:59:34.195245 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":32}
I20260809 18:59:34.195367 17198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.192363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42739 (local address 127.23.229.3:42167)
0809 18:59:34.192614 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:34.192626 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:34.192678 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:34.192835 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:34.192836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:34.192838 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:34.192924 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.192925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.193614 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.193615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.194470 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:34.194473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.195027 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.195028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:34.195103 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.195107 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:59:34.195177 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:59:34.195222 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":78,"thread_start_us":151,"threads_started":1}
I20260809 18:59:34.195839 16880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1805f450a0504827acca5e287418e645" candidate_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" is_pre_election: true
I20260809 18:59:34.195904 16680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1805f450a0504827acca5e287418e645" candidate_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ae486f98ce4290a37e25c4f361c196" is_pre_election: true
I20260809 18:59:34.196038 16680 raft_consensus.cc:2454] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 in term 0.
I20260809 18:59:34.196029 16880 raft_consensus.cc:2454] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 in term 0.
I20260809 18:59:34.196302 16990 leader_election.cc:302] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, 214c709c0e7f4f3390bcc209eea4b5aa; no voters:
I20260809 18:59:34.196519 17192 raft_consensus.cc:2781] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:34.196622 17192 raft_consensus.cc:482] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:34.196661 17192 raft_consensus.cc:3037] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:34.197471 17192 raft_consensus.cc:504] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.197656 17192 leader_election.cc:288] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1:42739), 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457)
I20260809 18:59:34.197867 16680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1805f450a0504827acca5e287418e645" candidate_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ae486f98ce4290a37e25c4f361c196"
I20260809 18:59:34.197929 16880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1805f450a0504827acca5e287418e645" candidate_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "214c709c0e7f4f3390bcc209eea4b5aa"
I20260809 18:59:34.197997 16680 raft_consensus.cc:3037] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:34.198064 16880 raft_consensus.cc:3037] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:34.198853 16680 raft_consensus.cc:2454] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 in term 1.
I20260809 18:59:34.198841 16880 raft_consensus.cc:2454] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 in term 1.
I20260809 18:59:34.199115 16990 leader_election.cc:302] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, 214c709c0e7f4f3390bcc209eea4b5aa; no voters:
I20260809 18:59:34.199266 17192 raft_consensus.cc:2781] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:34.199463 17192 raft_consensus.cc:686] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, State: Running, Role: LEADER
I20260809 18:59:34.199576 17192 consensus_queue.cc:237] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:34.200686 16457 catalog_manager.cc:5495] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } health_report { overall_health: UNKNOWN } } }
I20260809 18:59:34.214229 17177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.211822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35884 (local address 127.23.229.3:34031)
0809 18:59:34.211886 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:34.211887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:34.211895 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:59:34.211933 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:34.211934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:34.211954 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:34.212021 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:34.212148 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.212699 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.213495 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:34.213677 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:34.213725 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:34.213856 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:34.214003 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:34.214085 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:34.214131 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 18:59:34.214148 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 18:59:34.216130 16880 raft_consensus.cc:1261] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Refusing update from remote peer 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:34.216142 16680 raft_consensus.cc:1261] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Refusing update from remote peer 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:34.216552 17200 consensus_queue.cc:1035] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:34.216696 17192 consensus_queue.cc:1035] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:34.220080 17207 mvcc.cc:205] Tried to move back new op lower bound from 7316692886386458624 to 7316692886322384896. Current Snapshot: MvccSnapshot[applied={T|T < 7316692886386458624 or (T in {7316692886386458624})}]
I20260809 18:59:34.220945 17205 mvcc.cc:205] Tried to move back new op lower bound from 7316692886386458624 to 7316692886322384896. Current Snapshot: MvccSnapshot[applied={T|T < 7316692886386458624 or (T in {7316692886386458624})}]
I20260809 18:59:34.221535 16458 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:34.221639 16458 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:34.222419 16458 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Sending DeleteTablet for 3 replicas of tablet 1805f450a0504827acca5e287418e645
I20260809 18:59:34.222836 16641 tablet_service.cc:1514] Processing DeleteTablet for tablet 1805f450a0504827acca5e287418e645 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:36834
I20260809 18:59:34.222870 17058 tablet_service.cc:1514] Processing DeleteTablet for tablet 1805f450a0504827acca5e287418e645 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:35870
I20260809 18:59:34.223096 17220 tablet_replica.cc:330] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: stopping tablet replica
I20260809 18:59:34.223093 16852 tablet_service.cc:1514] Processing DeleteTablet for tablet 1805f450a0504827acca5e287418e645 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:49712
I20260809 18:59:34.223210 17220 raft_consensus.cc:2229] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:34.223328 17220 raft_consensus.cc:2258] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:34.223340 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 16557
I20260809 18:59:34.231839 17223 tablet_replica.cc:330] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: stopping tablet replica
I20260809 18:59:34.232060 17223 raft_consensus.cc:2229] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:34.232270 17223 raft_consensus.cc:2258] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:34.232808 17222 tablet_replica.cc:330] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: stopping tablet replica
I20260809 18:59:34.232936 17222 raft_consensus.cc:2229] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:59:34.233065 17222 raft_consensus.cc:2258] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:34.233160 17223 ts_tablet_manager.cc:1905] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:34.235059 17223 ts_tablet_manager.cc:1918] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:34.235163 17223 log.cc:1196] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/1805f450a0504827acca5e287418e645
I20260809 18:59:34.235432 17223 ts_tablet_manager.cc:1939] T 1805f450a0504827acca5e287418e645 P 214c709c0e7f4f3390bcc209eea4b5aa: Deleting consensus metadata
I20260809 18:59:34.235992 16443 catalog_manager.cc:4841] TS 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457): tablet 1805f450a0504827acca5e287418e645 (table test-table [id=b4d03417b24b470991d558eec911874e]) successfully deleted
I20260809 18:59:34.236850 17222 ts_tablet_manager.cc:1905] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:34.238142 17222 ts_tablet_manager.cc:1918] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:34.238246 17222 log.cc:1196] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/1805f450a0504827acca5e287418e645
I20260809 18:59:34.238507 17222 ts_tablet_manager.cc:1939] T 1805f450a0504827acca5e287418e645 P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Deleting consensus metadata
I20260809 18:59:34.239010 16442 catalog_manager.cc:4841] TS 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031): tablet 1805f450a0504827acca5e287418e645 (table test-table [id=b4d03417b24b470991d558eec911874e]) successfully deleted
W20260809 18:59:34.239696 16442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:42739 (error 108)
I20260809 18:59:34.240093 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 16756
I20260809 18:59:34.240342 17180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:34.240204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42739 (local address 127.0.0.1:36850)
0809 18:59:34.240262 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:34.240301 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 18:59:34.261420 16442 catalog_manager.cc:4584] TS 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1:42739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1805f450a0504827acca5e287418e645: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42739: connect: Connection refused (error 111)
I20260809 18:59:34.267107 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 16960
I20260809 18:59:34.280977 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 16419
I20260809 18:59:54.296088 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42935
--webserver_interface=127.23.229.62
--webserver_port=44875
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:54.381434 17226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:54.381651 17226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:54.381675 17226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:54.382890 17226 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 18:59:54.382936 17226 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 18:59:54.382948 17226 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 18:59:54.382961 17226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:54.382973 17226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:54.383031 17226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:54.383050 17226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:54.383071 17226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:54.384608 17226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=44875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:54.384876 17226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:54.385140 17226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:54.394946 17235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:54.394946 17234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:54.394951 17237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:54.395227 17226 server_base.cc:1034] running on GCE node
I20260809 18:59:54.395557 17226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:54.395938 17226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:54.397089 17226 hybrid_clock.cc:648] HybridClock initialized: now 1786301994397062 us; error 40 us; skew 500 ppm
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:54.403139 17226 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 18:59:54.403671 17226 webserver.cc:460] Webserver started at http://127.23.229.62:44875/ using document root <none> and password file <none>
I20260809 18:59:54.403961 17226 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:54.404044 17226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:54.405581 17226 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:54.406334 17248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.406524 17226 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:54.406641 17226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "fdebca6086424130b305308b4b9552aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "072eacbd62b7104fa99a30194b9d5146"
server_key_iv: "334e731f0f7abef6167db9c7db6bd8c7"
server_key_version: "encryptionkey@0"
I20260809 18:59:54.407114 17226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:54.431157 17226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:54.433661 17226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:54.433854 17226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:54.438467 17226 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:42935
I20260809 18:59:54.438515 17338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:42935 every 8 connection(s)
I20260809 18:59:54.438978 17226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:54.440733 17339 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:59:54.441454 17339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Bootstrap starting.
I20260809 18:59:54.442723 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 17226
I20260809 18:59:54.443063 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:42739
--local_ip_for_outbound_sockets=127.23.229.1
--tserver_master_addrs=127.23.229.62:42935
--webserver_port=43591
--webserver_interface=127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:54.451122 17339 log.cc:824] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:54.453398 17339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:54.453737 17339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Bootstrap complete.
I20260809 18:59:54.456231 17339 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:54.456512 17339 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdebca6086424130b305308b4b9552aa, State: Initialized, Role: FOLLOWER
I20260809 18:59:54.456738 17339 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:54.456841 17339 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:54.456903 17339 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:54.456952 17339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:59:54.457996 17339 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:54.458128 17339 leader_election.cc:302] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdebca6086424130b305308b4b9552aa; no voters:
I20260809 18:59:54.458355 17339 leader_election.cc:288] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:59:54.458397 17343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:59:54.458539 17343 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 LEADER]: Becoming Leader. State: Replica: fdebca6086424130b305308b4b9552aa, State: Running, Role: LEADER
I20260809 18:59:54.458655 17339 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:54.458629 17343 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 18:59:54.458956 17343 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdebca6086424130b305308b4b9552aa. Latest consensus state: current_term: 2 leader_uuid: "fdebca6086424130b305308b4b9552aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } } }
I20260809 18:59:54.459035 17343 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:54.458961 17344 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fdebca6086424130b305308b4b9552aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } } }
I20260809 18:59:54.459265 17344 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:54.459266 17352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:54.460270 17352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:54.460457 17352 catalog_manager.cc:1259] Loaded cluster ID: 8c47fb5ac20e45e887473906fd322649
I20260809 18:59:54.460687 17352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:54.461892 17352 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:54.462083 17352 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Loaded TSK: 0
I20260809 18:59:54.479403 17352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Generated new TSK 1
I20260809 18:59:54.479537 17352 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:59:54.532510 17341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:54.532737 17341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:54.532763 17341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:54.534054 17341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:54.534106 17341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:54.534135 17341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 18:59:54.535707 17341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:42739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=43591
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:54.535998 17341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:54.536274 17341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:54.541863 17377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:54.542079 17341 server_base.cc:1034] running on GCE node
W20260809 18:59:54.541877 17380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:54.541889 17378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:54.542462 17341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:54.542747 17341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:54.543947 17341 hybrid_clock.cc:648] HybridClock initialized: now 1786301994543923 us; error 45 us; skew 500 ppm
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:54.546957 17341 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 18:59:54.547475 17341 webserver.cc:460] Webserver started at http://127.23.229.1:43591/ using document root <none> and password file <none>
I20260809 18:59:54.547744 17341 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:54.547842 17341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:54.549515 17341 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:54.550313 17389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.550534 17341 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:54.550625 17341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "14ae486f98ce4290a37e25c4f361c196"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "2ea15a07bc2a8256b31cc4abefe23a68"
server_key_iv: "2c1241a44c7dd2facd2bba12500530af"
server_key_version: "encryptionkey@0"
I20260809 18:59:54.551007 17341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:54.571147 17341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:54.573547 17341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:54.573704 17341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:54.573978 17341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:54.574570 17403 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 18:59:54.576612 17341 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:59:54.576676 17341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 18:59:54.576721 17341 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:59:54.577365 17341 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:59:54.577435 17341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:54.577504 17403 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Bootstrap starting.
I20260809 18:59:54.584951 17341 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:42739
I20260809 18:59:54.585364 17341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:54.585842 17571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:42739 every 8 connection(s)
I20260809 18:59:54.588531 17403 log.cc:824] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:54.589502 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 17341
I20260809 18:59:54.589804 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:41457
--local_ip_for_outbound_sockets=127.23.229.2
--tserver_master_addrs=127.23.229.62:42935
--webserver_port=41929
--webserver_interface=127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:54.591306 17403 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:54.591630 17403 tablet_bootstrap.cc:492] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Bootstrap complete.
I20260809 18:59:54.593341 17403 ts_tablet_manager.cc:1397] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.007s
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:54.594720 17403 raft_consensus.cc:348] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:54.595043 17403 raft_consensus.cc:729] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ae486f98ce4290a37e25c4f361c196, State: Initialized, Role: FOLLOWER
I20260809 18:59:54.598812 17575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.586354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:40009)
0809 18:59:54.586754 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.586789 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:54.587335 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:54.587820 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:54.587824 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:54.588132 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:54.588332 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.588337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.590140 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.590141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.591569 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.591573 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.592331 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.592333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.592466 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.593201 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:54.593214 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:54.594928 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:54.597003 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.597011 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.597013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.597322 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.597617 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.597618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.597618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.597733 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.598137 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:54.598144 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:54.598285 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 18:59:54.598409 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 18:59:54.598605 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":106,"threads_started":1}
I20260809 18:59:54.598811 17576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.586454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:40009 (local address 127.23.229.62:42935)
0809 18:59:54.586670 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.586679 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.586914 (+ 235us) server_negotiation.cc:407] Connection header received
0809 18:59:54.587588 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.587593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.587640 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.587782 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:54.588472 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.589981 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.591706 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.592211 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.592341 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.595046 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:54.595051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:54.595052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:54.595066 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:54.596895 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.597436 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.597440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.597440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.597536 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.597808 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.597809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.597809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.598052 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:54.598143 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.598492 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.598628 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":91,"threads_started":1}
I20260809 18:59:54.599963 17572 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42935
I20260809 18:59:54.600071 17572 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:54.600268 17572 heartbeater.cc:511] Master 127.23.229.62:42935 requested a full tablet report, sending...
I20260809 18:59:54.600585 17403 consensus_queue.cc:260] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } } peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } }
I20260809 18:59:54.601241 17403 ts_tablet_manager.cc:1428] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260809 18:59:54.601750 17281 ts_manager.cc:194] Registered new tserver with Master: 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1:42739)
I20260809 18:59:54.602986 17281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:40009
I20260809 18:59:54.603840 17572 heartbeater.cc:503] Master 127.23.229.62:42935 was elected leader, sending a full tablet report...
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.1@KRBTEST.COM
I20260809 18:59:54.612100 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.602397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42739 (local address 127.0.0.1:42720)
0809 18:59:54.602796 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.602831 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:54.602907 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:54.603393 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:54.603397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:54.604447 (+ 1050us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:54.604569 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.604572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.605657 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.605658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.606223 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.606224 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.606712 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.606713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.606794 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.607376 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:54.607383 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:54.608795 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:54.610852 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.610858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.610859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.611103 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.611320 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.611321 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.611322 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.611395 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.611698 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:54.611705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:54.611760 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 18:59:54.611856 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 18:59:54.611989 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":96,"threads_started":1}
I20260809 18:59:54.612100 17582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.602651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42720 (local address 127.23.229.1:42739)
0809 18:59:54.603039 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.603043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.603053 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:59:54.603159 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.603161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.603177 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.603243 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:54.604784 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.605569 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.606322 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.606630 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.606711 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.608891 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:54.608901 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:54.608901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:54.608909 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:54.610717 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.611175 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.611179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.611179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.611247 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.611467 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.611468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.611468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.611622 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:54.611707 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.611914 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.612008 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":64,"threads_started":1}
I20260809 18:59:54.612932 17470 tablet_service.cc:1514] Processing DeleteTablet for tablet 1805f450a0504827acca5e287418e645 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:34 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:42720
I20260809 18:59:54.613528 17583 tablet_replica.cc:330] stopping tablet replica
I20260809 18:59:54.613646 17583 raft_consensus.cc:2229] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:54.613719 17583 raft_consensus.cc:2258] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:54.614085 17583 ts_tablet_manager.cc:1905] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:54.616391 17583 ts_tablet_manager.cc:1918] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:54.616504 17583 log.cc:1196] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal/wals/1805f450a0504827acca5e287418e645
I20260809 18:59:54.616755 17583 ts_tablet_manager.cc:1939] T 1805f450a0504827acca5e287418e645 P 14ae486f98ce4290a37e25c4f361c196: Deleting consensus metadata
I20260809 18:59:54.617532 17255 catalog_manager.cc:4841] TS 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1:42739): tablet 1805f450a0504827acca5e287418e645 (table test-table [id=b4d03417b24b470991d558eec911874e]) successfully deleted
W20260809 18:59:54.684898 17579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:54.685124 17579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:54.685148 17579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:54.686252 17579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:54.686288 17579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:54.686314 17579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 18:59:54.687762 17579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:41457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=41929
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:54.687974 17579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:54.688158 17579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:54.693364 17590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:54.693351 17592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:54.693351 17589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:54.693854 17579 server_base.cc:1034] running on GCE node
I20260809 18:59:54.694020 17579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:54.694262 17579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:54.695438 17579 hybrid_clock.cc:648] HybridClock initialized: now 1786301994695418 us; error 30 us; skew 500 ppm
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:54.697945 17579 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 18:59:54.698424 17579 webserver.cc:460] Webserver started at http://127.23.229.2:41929/ using document root <none> and password file <none>
I20260809 18:59:54.698675 17579 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:54.698770 17579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:54.700208 17579 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:54.701026 17604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.701236 17579 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:54.701363 17579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "214c709c0e7f4f3390bcc209eea4b5aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "d6618ae47197ce9546a76d6600aaa886"
server_key_iv: "1c496d65be71cf8cb0f569103298b528"
server_key_version: "encryptionkey@0"
I20260809 18:59:54.701741 17579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:54.715667 17579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:54.718026 17579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:54.718206 17579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:54.718472 17579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:54.718811 17579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:54.718868 17579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.718906 17579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:54.718952 17579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.725036 17579 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:41457
I20260809 18:59:54.725085 17771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:41457 every 8 connection(s)
I20260809 18:59:54.725453 17579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:54.729501 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 17579
I20260809 18:59:54.729816 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:34031
--local_ip_for_outbound_sockets=127.23.229.3
--tserver_master_addrs=127.23.229.62:42935
--webserver_port=35325
--webserver_interface=127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:54.736335 17576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.726223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:36083 (local address 127.23.229.62:42935)
0809 18:59:54.726293 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.726295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.726528 (+ 233us) server_negotiation.cc:407] Connection header received
0809 18:59:54.727083 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.727085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.727103 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.727158 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:54.728181 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.728821 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.730279 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.730493 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.730573 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.733132 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:54.733134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:54.733134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:54.733142 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:54.734675 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.735230 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.735231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.735231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.735284 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.735586 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.735586 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.735586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.735691 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:54.735743 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.736183 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.736268 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:59:54.736694 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.726205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:36083)
0809 18:59:54.726392 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.726437 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:54.726969 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:54.727251 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:54.727254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:54.727858 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:54.728066 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.728071 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.728933 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.728934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.730174 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.730177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.730603 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.730604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.730769 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.731368 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:54.731379 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:54.733030 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:54.734759 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.734768 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.734771 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.735142 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.735347 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.735348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.735349 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.735513 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.735761 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:54.735769 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:54.735982 (+ 213us) client_negotiation.cc:769] Sending connection context
0809 18:59:54.736127 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 18:59:54.736349 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260809 18:59:54.737282 17772 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42935
I20260809 18:59:54.737416 17772 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:54.737645 17772 heartbeater.cc:511] Master 127.23.229.62:42935 requested a full tablet report, sending...
I20260809 18:59:54.738128 17281 ts_manager.cc:194] Registered new tserver with Master: 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457)
I20260809 18:59:54.738507 17281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:36083
W20260809 18:59:54.819413 17775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:54.819630 17775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:54.819654 17775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:54.820879 17775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:54.820924 17775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:54.820951 17775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 18:59:54.822455 17775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:34031
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=35325
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:59:54.822722 17775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:54.822968 17775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:54.828125 17783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:54.828186 17781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:54.828136 17780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:54.828529 17775 server_base.cc:1034] running on GCE node
I20260809 18:59:54.828756 17775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:54.829002 17775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:54.830150 17775 hybrid_clock.cc:648] HybridClock initialized: now 1786301994830129 us; error 37 us; skew 500 ppm
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:54.832784 17775 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 18:59:54.833303 17775 webserver.cc:460] Webserver started at http://127.23.229.3:35325/ using document root <none> and password file <none>
I20260809 18:59:54.833564 17775 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:54.833648 17775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:54.835090 17775 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:59:54.835757 17795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.835986 17775 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:59:54.836130 17775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "f759f6654f3eb5f789ff5e16fdd232b9"
server_key_iv: "4417c6eb49cdcdcabee179dfe1a80215"
server_key_version: "encryptionkey@0"
I20260809 18:59:54.836599 17775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:54.848347 17775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:54.850319 17775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:54.850435 17775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:54.850617 17775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:54.850955 17775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:54.850991 17775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.851042 17775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:54.851070 17775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:54.857362 17775 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:34031
I20260809 18:59:54.857405 17979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:34031 every 8 connection(s)
I20260809 18:59:54.857764 17775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:59:54 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 18:59:54.866648 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 17775
I20260809 18:59:54.867957 17576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.858517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:58883 (local address 127.23.229.62:42935)
0809 18:59:54.858596 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.858598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.858847 (+ 249us) server_negotiation.cc:407] Connection header received
0809 18:59:54.859345 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.859346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.859357 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.859412 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:54.860519 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.861064 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.862041 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.862256 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.862317 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.864860 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:54.864862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:54.864863 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:54.864872 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:54.866250 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.866674 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.866676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.866676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.866746 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.867123 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.867124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.867125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.867315 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:54.867394 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.867802 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.867889 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:59:54.868270 17983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.858497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:58883)
0809 18:59:54.858706 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.858755 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:54.859256 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:54.859468 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:54.859471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:54.860182 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:54.860386 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.860390 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.861153 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.861154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.861955 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.861957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.862336 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.862337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.862441 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.862964 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:54.862972 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:54.864724 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:54.866335 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.866341 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.866344 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.866573 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.866853 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:54.866855 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:54.866855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:54.867026 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:54.867425 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:54.867431 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:54.867611 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 18:59:54.867757 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 18:59:54.867990 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":126,"threads_started":1}
I20260809 18:59:54.868902 17981 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42935
I20260809 18:59:54.869017 17981 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:54.869217 17981 heartbeater.cc:511] Master 127.23.229.62:42935 requested a full tablet report, sending...
I20260809 18:59:54.869699 17281 ts_manager.cc:194] Registered new tserver with Master: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
I20260809 18:59:54.870215 17281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:58883
I20260809 18:59:54.874269 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.867100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57294 (local address 127.23.229.62:42935)
0809 18:59:54.867446 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.867447 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.867454 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:59:54.867480 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.867480 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.867490 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.867542 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:54.868568 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.869230 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.870383 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.870664 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.870739 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.871991 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:54.871992 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:54.871993 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:54.871999 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:54.873325 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.873645 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.873646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.873647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.873700 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:54.873871 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:54.873872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:54.873872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:54.873969 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:54.874111 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.874138 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.874202 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":69,"threads_started":1}
I20260809 18:59:54.875061 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:54.877785 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.875453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57306 (local address 127.23.229.62:42935)
0809 18:59:54.875525 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.875528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.875656 (+ 128us) server_negotiation.cc:407] Connection header received
0809 18:59:54.875695 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.875696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.875725 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.875786 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:54.875884 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.876331 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.877109 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.877330 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.877400 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.877529 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:54.877628 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:54.877685 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.877716 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.877735 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 18:59:54.878126 17281 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:57306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:54.879743 17281 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:59:54.882462 17470 tablet_service.cc:1467] Processing CreateTablet for tablet d5999b5762f547aba3d98d422e0c990f (DEFAULT_TABLE table=test-table [id=b8d857896c2d4ec6bc56ec16ce6a571f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:54.882695 17470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5999b5762f547aba3d98d422e0c990f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:54.884303 17403 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Bootstrap starting.
I20260809 18:59:54.884687 17403 tablet_bootstrap.cc:654] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:54.885659 17403 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: No bootstrap required, opened a new log
I20260809 18:59:54.885721 17403 ts_tablet_manager.cc:1397] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:59:54.885861 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.881849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:41457 (local address 127.0.0.1:48798)
0809 18:59:54.881923 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.881935 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:54.881979 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:54.882557 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:54.882558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:54.882560 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:54.882610 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.882611 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.883654 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.883655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.884602 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.884605 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.885582 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.885583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.885655 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.885680 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 18:59:54.885744 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 18:59:54.885795 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 18:59:54.885888 17403 raft_consensus.cc:348] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:54.885972 17403 raft_consensus.cc:374] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:54.886034 17403 raft_consensus.cc:729] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ae486f98ce4290a37e25c4f361c196, State: Initialized, Role: FOLLOWER
I20260809 18:59:54.886086 17403 consensus_queue.cc:260] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:54.886181 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.882192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48798 (local address 127.23.229.2:41457)
0809 18:59:54.882390 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.882394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.882402 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:59:54.882437 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.882438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.882452 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.882552 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:54.882697 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.883568 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.884696 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.885506 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.885582 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.885640 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.886044 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.886097 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":120,"threads_started":1}
I20260809 18:59:54.886189 17403 ts_tablet_manager.cc:1428] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:59:54.886680 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.881960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:34031 (local address 127.0.0.1:46236)
0809 18:59:54.882151 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.882164 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:54.882218 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:54.882875 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:54.882876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:54.882878 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:54.882930 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.882932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.884223 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.884224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.885260 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:54.885262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.886189 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.886191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:54.886516 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.886521 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:59:54.886578 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 18:59:54.886616 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":106,"threads_started":1}
I20260809 18:59:54.887038 17991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.882426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46236 (local address 127.23.229.3:34031)
0809 18:59:54.882649 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:54.882653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:54.882664 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:54.882705 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:54.882707 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:54.882723 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:54.883014 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:54.883103 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.884126 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.885336 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:54.886085 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:54.886802 (+ 717us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:54.886890 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:54.886916 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:59:54.886961 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":106,"threads_started":1}
I20260809 18:59:54.886945 17673 tablet_service.cc:1467] Processing CreateTablet for tablet d5999b5762f547aba3d98d422e0c990f (DEFAULT_TABLE table=test-table [id=b8d857896c2d4ec6bc56ec16ce6a571f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:54.887310 17673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5999b5762f547aba3d98d422e0c990f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:54.887634 17865 tablet_service.cc:1467] Processing CreateTablet for tablet d5999b5762f547aba3d98d422e0c990f (DEFAULT_TABLE table=test-table [id=b8d857896c2d4ec6bc56ec16ce6a571f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:54.887931 17865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5999b5762f547aba3d98d422e0c990f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:54.890225 17994 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Bootstrap starting.
I20260809 18:59:54.890902 17995 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Bootstrap starting.
I20260809 18:59:54.890971 17994 tablet_bootstrap.cc:654] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:54.891453 17995 tablet_bootstrap.cc:654] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:54.891498 17994 log.cc:824] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:54.892109 17995 log.cc:824] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:54.892366 17994 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: No bootstrap required, opened a new log
I20260809 18:59:54.892447 17994 ts_tablet_manager.cc:1397] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:54.892886 17995 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: No bootstrap required, opened a new log
I20260809 18:59:54.892971 17995 ts_tablet_manager.cc:1397] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:54.894205 17994 raft_consensus.cc:348] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:54.894358 17994 raft_consensus.cc:374] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:54.894382 17994 raft_consensus.cc:729] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 214c709c0e7f4f3390bcc209eea4b5aa, State: Initialized, Role: FOLLOWER
I20260809 18:59:54.894507 17994 consensus_queue.cc:260] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:54.894795 17994 ts_tablet_manager.cc:1428] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:54.894706 17995 raft_consensus.cc:348] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:54.894827 17772 heartbeater.cc:503] Master 127.23.229.62:42935 was elected leader, sending a full tablet report...
I20260809 18:59:54.894878 17995 raft_consensus.cc:374] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:54.894915 17995 raft_consensus.cc:729] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, State: Initialized, Role: FOLLOWER
I20260809 18:59:54.895031 17995 consensus_queue.cc:260] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:54.895310 17995 ts_tablet_manager.cc:1428] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:59:54.895334 17981 heartbeater.cc:503] Master 127.23.229.62:42935 was elected leader, sending a full tablet report...
W20260809 18:59:54.976025 17773 tablet.cc:2369] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:59:55.086588 17573 tablet.cc:2369] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:59:55.108377 17982 tablet.cc:2369] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:55.129503 17580 raft_consensus.cc:482] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:55.129676 17580 raft_consensus.cc:504] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:55.130167 17580 leader_election.cc:288] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457), 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
I20260809 18:59:55.133391 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.130472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:41137 (local address 127.23.229.2:41457)
0809 18:59:55.130524 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:55.130527 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:55.130639 (+ 112us) server_negotiation.cc:407] Connection header received
0809 18:59:55.130774 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:55.130775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:55.130792 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:55.130891 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:55.131042 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.131539 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.132650 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.133038 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.133125 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:55.133135 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:55.133277 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 18:59:55.133316 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:59:55.133412 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.130378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:41457 (local address 127.23.229.1:41137)
0809 18:59:55.130553 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:55.130572 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:55.130673 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:55.130900 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:55.130901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:55.130903 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:55.130970 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:55.130972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.131638 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.131639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:55.132545 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:55.132548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.133127 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.133128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:55.133192 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:55.133200 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 18:59:55.133272 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:59:55.133316 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":25,"thread_start_us":76,"threads_started":1}
I20260809 18:59:55.133392 17991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.130614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:35677 (local address 127.23.229.3:34031)
0809 18:59:55.130664 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:55.130666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:55.130696 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:59:55.130783 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:55.130786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:55.130808 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:55.130878 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:55.131062 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.131544 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.132619 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.132998 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.133099 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:55.133109 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:55.133273 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 18:59:55.133315 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:59:55.133461 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.130503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:34031 (local address 127.23.229.1:35677)
0809 18:59:55.130633 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:55.130646 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:55.130710 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:55.130891 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:55.130892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:55.130894 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:55.130983 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:55.130985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.131640 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.131641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:55.132518 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:55.132521 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.133101 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.133102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:55.133174 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:55.133195 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 18:59:55.133267 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:59:55.133315 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":66,"thread_start_us":65,"threads_started":1}
I20260809 18:59:55.133793 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5999b5762f547aba3d98d422e0c990f" candidate_uuid: "14ae486f98ce4290a37e25c4f361c196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" is_pre_election: true
I20260809 18:59:55.133994 17700 raft_consensus.cc:2454] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14ae486f98ce4290a37e25c4f361c196 in term 0.
I20260809 18:59:55.133970 17900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5999b5762f547aba3d98d422e0c990f" candidate_uuid: "14ae486f98ce4290a37e25c4f361c196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" is_pre_election: true
I20260809 18:59:55.134089 17900 raft_consensus.cc:2454] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14ae486f98ce4290a37e25c4f361c196 in term 0.
I20260809 18:59:55.134280 17395 leader_election.cc:302] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14ae486f98ce4290a37e25c4f361c196, 214c709c0e7f4f3390bcc209eea4b5aa; no voters:
I20260809 18:59:55.134444 17580 raft_consensus.cc:2781] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:55.134508 17580 raft_consensus.cc:482] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:55.134531 17580 raft_consensus.cc:3037] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:55.135262 17580 raft_consensus.cc:504] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:55.135416 17580 leader_election.cc:288] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 1 election: Requested vote from peers 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457), 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
I20260809 18:59:55.135558 17900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5999b5762f547aba3d98d422e0c990f" candidate_uuid: "14ae486f98ce4290a37e25c4f361c196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5"
I20260809 18:59:55.135596 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5999b5762f547aba3d98d422e0c990f" candidate_uuid: "14ae486f98ce4290a37e25c4f361c196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "214c709c0e7f4f3390bcc209eea4b5aa"
I20260809 18:59:55.135663 17900 raft_consensus.cc:3037] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:55.135669 17700 raft_consensus.cc:3037] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:55.136392 17700 raft_consensus.cc:2454] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14ae486f98ce4290a37e25c4f361c196 in term 1.
I20260809 18:59:55.136394 17900 raft_consensus.cc:2454] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14ae486f98ce4290a37e25c4f361c196 in term 1.
I20260809 18:59:55.136565 17395 leader_election.cc:302] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14ae486f98ce4290a37e25c4f361c196, 214c709c0e7f4f3390bcc209eea4b5aa; no voters:
I20260809 18:59:55.136682 17580 raft_consensus.cc:2781] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:55.136814 17580 raft_consensus.cc:686] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 LEADER]: Becoming Leader. State: Replica: 14ae486f98ce4290a37e25c4f361c196, State: Running, Role: LEADER
I20260809 18:59:55.136919 17580 consensus_queue.cc:237] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 18:59:55.137811 17281 catalog_manager.cc:5495] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1). New cstate: current_term: 1 leader_uuid: "14ae486f98ce4290a37e25c4f361c196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } health_report { overall_health: HEALTHY } } }
I20260809 18:59:55.170322 18008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.167691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.23.229.1:42739)
0809 18:59:55.167880 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:55.167881 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:55.167889 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:59:55.167945 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:55.167946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:55.167967 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:55.168064 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:55.168206 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.168763 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.169515 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.169742 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.169821 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:55.170007 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:55.170061 (+ 54us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 18:59:55.170222 (+ 161us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42734: token expired
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":91,"threads_started":1}
W20260809 18:59:55.170418 18008 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42734: token expired
I20260809 18:59:55.176915 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.170751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57314 (local address 127.23.229.62:42935)
0809 18:59:55.170829 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:55.170831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:55.170841 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:59:55.170866 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:55.170867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:55.170877 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:55.170926 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:55.171424 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.171893 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.172644 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.172839 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.172908 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:55.174283 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:55.174286 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:55.174286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:55.174294 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:55.175671 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:55.176067 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:55.176068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:55.176069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:55.176134 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:55.176342 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:55.176343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:55.176343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:55.176467 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:55.176602 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:55.176717 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 18:59:55.176809 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:59:55.180277 18008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.177953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42750 (local address 127.23.229.1:42739)
0809 18:59:55.178034 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:55.178036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:55.178047 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:59:55.178123 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:55.178124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:55.178135 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:55.178191 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:55.178280 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.178761 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.179473 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:55.179682 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:55.179757 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:55.179923 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:55.180041 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:55.180103 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:55.180167 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 18:59:55.180188 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:59:55.182031 17900 raft_consensus.cc:1261] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 FOLLOWER]: Refusing update from remote peer 14ae486f98ce4290a37e25c4f361c196: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:55.182031 17700 raft_consensus.cc:1261] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Refusing update from remote peer 14ae486f98ce4290a37e25c4f361c196: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:55.182471 18005 consensus_queue.cc:1035] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:55.182649 17580 consensus_queue.cc:1035] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:55.187727 17281 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:55.187839 17281 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:55.188663 17281 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Sending DeleteTablet for 3 replicas of tablet d5999b5762f547aba3d98d422e0c990f
I20260809 18:59:55.189013 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 17341
I20260809 18:59:55.189066 17865 tablet_service.cc:1514] Processing DeleteTablet for tablet d5999b5762f547aba3d98d422e0c990f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:55 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:46236
I20260809 18:59:55.189005 17673 tablet_service.cc:1514] Processing DeleteTablet for tablet d5999b5762f547aba3d98d422e0c990f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:55 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:48798
I20260809 18:59:55.192077 18026 tablet_replica.cc:330] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: stopping tablet replica
I20260809 18:59:55.192191 18026 raft_consensus.cc:2229] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:55.192349 18026 raft_consensus.cc:2258] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:55.194111 18026 ts_tablet_manager.cc:1905] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:55.195421 18027 tablet_replica.cc:330] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: stopping tablet replica
I20260809 18:59:55.195573 18027 raft_consensus.cc:2229] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:55.195713 18027 raft_consensus.cc:2258] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:55.195978 18026 ts_tablet_manager.cc:1918] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:55.196136 18026 log.cc:1196] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/d5999b5762f547aba3d98d422e0c990f
I20260809 18:59:55.196656 18026 ts_tablet_manager.cc:1939] T d5999b5762f547aba3d98d422e0c990f P 097ca3dc5ecc4a9bb7e8e4b1ad527bf5: Deleting consensus metadata
I20260809 18:59:55.198213 17255 catalog_manager.cc:4841] TS 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031): tablet d5999b5762f547aba3d98d422e0c990f (table test-table [id=b8d857896c2d4ec6bc56ec16ce6a571f]) successfully deleted
I20260809 18:59:55.198273 18027 ts_tablet_manager.cc:1905] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:55.199579 18027 ts_tablet_manager.cc:1918] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:55.199681 18027 log.cc:1196] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/d5999b5762f547aba3d98d422e0c990f
I20260809 18:59:55.199946 18027 ts_tablet_manager.cc:1939] T d5999b5762f547aba3d98d422e0c990f P 214c709c0e7f4f3390bcc209eea4b5aa: Deleting consensus metadata
I20260809 18:59:55.200461 17256 catalog_manager.cc:4841] TS 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457): tablet d5999b5762f547aba3d98d422e0c990f (table test-table [id=b8d857896c2d4ec6bc56ec16ce6a571f]) successfully deleted
W20260809 18:59:55.211259 17255 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:42739 (error 108)
I20260809 18:59:55.211491 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 17579
I20260809 18:59:55.213642 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.213499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42739 (local address 127.0.0.1:42758)
0809 18:59:55.213561 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:55.213609 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 18:59:55.213793 17255 catalog_manager.cc:4584] TS 14ae486f98ce4290a37e25c4f361c196 (127.23.229.1:42739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d5999b5762f547aba3d98d422e0c990f: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42739: connect: Connection refused (error 111)
I20260809 18:59:55.225436 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 17775
I20260809 18:59:55.237151 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 17226
I20260809 19:00:15.249585 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42935
--webserver_interface=127.23.229.62
--webserver_port=44875
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:15.334928 18031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:15.335192 18031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:15.335232 18031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:15.336369 18031 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 19:00:15.336439 18031 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 19:00:15.336463 18031 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 19:00:15.336483 18031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:15.336526 18031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:15.336558 18031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:15.336582 18031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:15.336611 18031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:15.338172 18031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=44875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:15.338472 18031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:15.338721 18031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:15.344034 18042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:15.344132 18031 server_base.cc:1034] running on GCE node
W20260809 19:00:15.344040 18039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:15.344045 18045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:15.344519 18031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:15.344827 18031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:15.345995 18031 hybrid_clock.cc:648] HybridClock initialized: now 1786302015345991 us; error 41 us; skew 500 ppm
Aug 09 19:00:15 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302015, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:15.348551 18031 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:00:15.349066 18031 webserver.cc:460] Webserver started at http://127.23.229.62:44875/ using document root <none> and password file <none>
I20260809 19:00:15.349327 18031 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:15.349399 18031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:15.350792 18031 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:15.351505 18054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.351683 18031 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:15.351792 18031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "fdebca6086424130b305308b4b9552aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "072eacbd62b7104fa99a30194b9d5146"
server_key_iv: "334e731f0f7abef6167db9c7db6bd8c7"
server_key_version: "encryptionkey@0"
I20260809 19:00:15.352166 18031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:15.373340 18031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:15.375355 18031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:15.375531 18031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:15.380316 18031 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:42935
I20260809 19:00:15.380411 18131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:42935 every 8 connection(s)
I20260809 19:00:15.380898 18031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:15.382490 18132 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:00:15.383517 18132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Bootstrap starting.
I20260809 19:00:15.386313 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 18031
I20260809 19:00:15.386674 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:42739
--local_ip_for_outbound_sockets=127.23.229.1
--tserver_master_addrs=127.23.229.62:42935
--webserver_port=43591
--webserver_interface=127.23.229.1
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:00:15.395735 18132 log.cc:824] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:15.398204 18132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:00:15.398569 18132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Bootstrap complete.
I20260809 19:00:15.401098 18132 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 19:00:15.401335 18132 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdebca6086424130b305308b4b9552aa, State: Initialized, Role: FOLLOWER
I20260809 19:00:15.401517 18132 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 19:00:15.401583 18132 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:15.401649 18132 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:15.401695 18132 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 2 FOLLOWER]: Advancing to term 3
I20260809 19:00:15.402841 18132 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 19:00:15.402961 18132 leader_election.cc:302] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdebca6086424130b305308b4b9552aa; no voters:
I20260809 19:00:15.403172 18132 leader_election.cc:288] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 19:00:15.403256 18140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 3 FOLLOWER]: Leader election won for term 3
I20260809 19:00:15.403419 18140 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [term 3 LEADER]: Becoming Leader. State: Replica: fdebca6086424130b305308b4b9552aa, State: Running, Role: LEADER
I20260809 19:00:15.403470 18132 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:15.403524 18140 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } }
I20260809 19:00:15.403806 18140 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdebca6086424130b305308b4b9552aa. Latest consensus state: current_term: 3 leader_uuid: "fdebca6086424130b305308b4b9552aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } } }
I20260809 19:00:15.403890 18140 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:15.403810 18141 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "fdebca6086424130b305308b4b9552aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdebca6086424130b305308b4b9552aa" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42935 } } }
I20260809 19:00:15.404085 18141 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:15.404091 18146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:15.405200 18146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:15.405390 18146 catalog_manager.cc:1259] Loaded cluster ID: 8c47fb5ac20e45e887473906fd322649
I20260809 19:00:15.405611 18146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:15.406431 18146 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:15.406642 18146 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Loaded TSK: 0
I20260809 19:00:15.406702 18146 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fdebca6086424130b305308b4b9552aa: Loaded TSK: 1
F20260809 19:00:15.406937 18146 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbb1d9469ad google::LogMessage::Fail() at ??:0
@ 0x7fbb1d94988a google::LogMessage::SendToLog() at ??:0
@ 0x7fbb1d9464de google::LogMessage::Flush() at ??:0
@ 0x7fbb1d947a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbb200b3104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fbb200b0d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fbb258a01cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fbb258a048e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fbb258a0594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fbb25866c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fbb25870ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbb1f8140d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbb1f809954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbb2066d6db start_thread at ??:0
@ 0x7fbb1c44461f clone at ??:0
W20260809 19:00:15.513337 18136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:15.513650 18136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:15.513690 18136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:15.515614 18136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:15.515686 18136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:15.515727 18136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 19:00:15.518070 18136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:42739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=43591
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:15.518380 18136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:15.518664 18136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:15.524631 18190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:15.524763 18192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:15.524657 18194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:15.525010 18136 server_base.cc:1034] running on GCE node
I20260809 19:00:15.525235 18136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:15.525540 18136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:15.526724 18136 hybrid_clock.cc:648] HybridClock initialized: now 1786302015526706 us; error 28 us; skew 500 ppm
Aug 09 19:00:15 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302015, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:15.529881 18136 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 19:00:15.530357 18136 webserver.cc:460] Webserver started at http://127.23.229.1:43591/ using document root <none> and password file <none>
I20260809 19:00:15.530616 18136 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:15.530689 18136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:15.532152 18136 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:15.532979 18202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.533171 18136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 19:00:15.533284 18136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "14ae486f98ce4290a37e25c4f361c196"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "2ea15a07bc2a8256b31cc4abefe23a68"
server_key_iv: "2c1241a44c7dd2facd2bba12500530af"
server_key_version: "encryptionkey@0"
I20260809 19:00:15.533663 18136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:15.549651 18136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:15.552222 18136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:15.552402 18136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:15.552706 18136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:15.553223 18214 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 19:00:15.555312 18136 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 19:00:15.555371 18136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 19:00:15.555415 18136 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 19:00:15.556105 18136 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 19:00:15.556164 18136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 19:00:15.556257 18214 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Bootstrap starting.
I20260809 19:00:15.563735 18136 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:42739
I20260809 19:00:15.563882 18381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:42739 every 8 connection(s)
I20260809 19:00:15.564193 18136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:15.564687 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 18136
I20260809 19:00:15.564983 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:41457
--local_ip_for_outbound_sockets=127.23.229.2
--tserver_master_addrs=127.23.229.62:42935
--webserver_port=41929
--webserver_interface=127.23.229.2
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:00:15.567708 18214 log.cc:824] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:15.570644 18214 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:00:15.571018 18214 tablet_bootstrap.cc:492] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Bootstrap complete.
I20260809 19:00:15.572307 18214 ts_tablet_manager.cc:1397] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.005s
I20260809 19:00:15.573788 18214 raft_consensus.cc:348] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 19:00:15.574131 18214 raft_consensus.cc:729] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ae486f98ce4290a37e25c4f361c196, State: Initialized, Role: FOLLOWER
I20260809 19:00:15.574278 18214 consensus_queue.cc:260] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 19:00:15.574577 18214 ts_tablet_manager.cc:1428] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196: Time spent starting tablet: real 0.002s user 0.003s sys 0.003s
W20260809 19:00:15.633312 18385 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:00:15.567270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:49891)
0809 19:00:15.567571 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.567627 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:15.568415 (+ 788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:15.633063 (+ 64648us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":104,"threads_started":1}
W20260809 19:00:15.633668 18382 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:42935 (0 consecutive failures): Network error: Failed to ping master at 127.23.229.62:42935: Client connection negotiation failed: client connection to 127.23.229.62:42935: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 19:00:15.634091 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.633948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:33819)
0809 19:00:15.634012 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.634061 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 19:00:15.634521 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.634426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:50349)
0809 19:00:15.634478 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.634503 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 19:00:15.634655 18382 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 19:00:15.653545 18384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:15.653766 18384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:15.653791 18384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:15.654994 18384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:15.655040 18384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:15.655067 18384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 19:00:15.656677 18384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:41457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=41929
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:15.656944 18384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:15.657202 18384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:15.662663 18399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:15.662663 18402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:15.662761 18384 server_base.cc:1034] running on GCE node
W20260809 19:00:15.662734 18395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:15.663158 18384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:15.663424 18384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:15.664556 18384 hybrid_clock.cc:648] HybridClock initialized: now 1786302015664535 us; error 43 us; skew 500 ppm
Aug 09 19:00:15 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302015, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:15.667241 18384 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 19:00:15.667784 18384 webserver.cc:460] Webserver started at http://127.23.229.2:41929/ using document root <none> and password file <none>
I20260809 19:00:15.668044 18384 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:15.668121 18384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:15.669642 18384 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:15.670303 18414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.670485 18384 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:15.670598 18384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "214c709c0e7f4f3390bcc209eea4b5aa"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "d6618ae47197ce9546a76d6600aaa886"
server_key_iv: "1c496d65be71cf8cb0f569103298b528"
server_key_version: "encryptionkey@0"
I20260809 19:00:15.671015 18384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:15.686549 18384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:15.688880 18384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:15.689064 18384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:15.689338 18384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:15.689693 18384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:15.689751 18384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.689790 18384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:15.689847 18384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.696539 18384 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:41457
I20260809 19:00:15.696609 18582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:41457 every 8 connection(s)
I20260809 19:00:15.696996 18384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:15.698207 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.697737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:50905)
0809 19:00:15.697932 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.698049 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":88,"threads_started":1}
W20260809 19:00:15.698690 18583 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:42935 (0 consecutive failures): Network error: Failed to ping master at 127.23.229.62:42935: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
I20260809 19:00:15.698989 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.698912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:59471)
0809 19:00:15.698945 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.698971 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260809 19:00:15.699230 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.699179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:41279)
0809 19:00:15.699201 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.699219 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260809 19:00:15.699347 18583 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:00:15.701749 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 18384
I20260809 19:00:15.702023 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:34031
--local_ip_for_outbound_sockets=127.23.229.3
--tserver_master_addrs=127.23.229.62:42935
--webserver_port=35325
--webserver_interface=127.23.229.3
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:15.790056 18587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:15.790273 18587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:15.790299 18587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:15.791487 18587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:15.791530 18587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:15.791558 18587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 19:00:15.793139 18587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:34031
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=35325
--tserver_master_addrs=127.23.229.62:42935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:15.793352 18587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:15.793548 18587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:15.799045 18599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:15.799019 18596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:15.799023 18594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:15.799060 18587 server_base.cc:1034] running on GCE node
I20260809 19:00:15.799420 18587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:15.799687 18587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:15.800858 18587 hybrid_clock.cc:648] HybridClock initialized: now 1786302015800840 us; error 35 us; skew 500 ppm
Aug 09 19:00:15 dist-test-slave-jq4t krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302015, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:15.803565 18587 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 19:00:15.804064 18587 webserver.cc:460] Webserver started at http://127.23.229.3:35325/ using document root <none> and password file <none>
I20260809 19:00:15.804347 18587 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:15.804399 18587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:15.805961 18587 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:15.806691 18607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.806896 18587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:15.807003 18587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-jq4t"
server_key: "f759f6654f3eb5f789ff5e16fdd232b9"
server_key_iv: "4417c6eb49cdcdcabee179dfe1a80215"
server_key_version: "encryptionkey@0"
I20260809 19:00:15.807418 18587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:15.825943 18587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:15.828626 18587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:15.828815 18587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:15.829105 18587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:15.829455 18587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:15.829514 18587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.829550 18587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:15.829581 18587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:15.835868 18587 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:34031
I20260809 19:00:15.835945 18792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:34031 every 8 connection(s)
I20260809 19:00:15.836398 18587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 19:00:15.837684 18795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.837246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:49461)
0809 19:00:15.837439 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.837525 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":85,"threads_started":1}
W20260809 19:00:15.838129 18793 heartbeater.cc:644] Failed to heartbeat to 127.23.229.62:42935 (0 consecutive failures): Network error: Failed to ping master at 127.23.229.62:42935: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
I20260809 19:00:15.838421 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 18587
I20260809 19:00:15.838474 18795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.838367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:59573)
0809 19:00:15.838420 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.838450 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 19:00:15.839038 18795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:15.838936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:53043)
0809 19:00:15.838990 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:15.839016 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 19:00:15.839171 18793 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:00:16.635442 18799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:16.635124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:59273)
0809 19:00:16.635299 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:16.635354 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":73,"threads_started":1}
I20260809 19:00:16.699882 18800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:16.699659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:41309)
0809 19:00:16.699795 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:16.699826 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260809 19:00:16.839740 18803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:16.839534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:41607)
0809 19:00:16.839654 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:16.839689 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260809 19:00:17.200367 18805 raft_consensus.cc:482] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:17.200585 18805 raft_consensus.cc:504] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 19:00:17.201033 18805 leader_election.cc:288] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457), 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
Aug 09 19:00:17 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302015, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.2@KRBTEST.COM
Aug 09 19:00:17 dist-test-slave-jq4t krb5kdc[16398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302015, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.3@KRBTEST.COM
I20260809 19:00:17.213726 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:17.201316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:58671 (local address 127.23.229.2:41457)
0809 19:00:17.201549 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:17.201558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:17.201576 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:00:17.202034 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:17.202036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:17.202080 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:17.202231 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:17.203071 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.203984 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.205176 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.205611 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.205755 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:17.208562 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:17.208569 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:17.208569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:17.208586 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:17.211528 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:17.212230 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:17.212234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:17.212234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:17.212354 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:17.212605 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:17.212606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:17.212606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:17.212908 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:17.213008 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:17.213477 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 19:00:17.213609 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":94,"threads_started":1}
I20260809 19:00:17.213726 18813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:17.201365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:53917 (local address 127.23.229.3:34031)
0809 19:00:17.201531 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:17.201543 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:17.201576 (+ 33us) server_negotiation.cc:407] Connection header received
0809 19:00:17.202040 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:17.202042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:17.202080 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:17.202247 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:17.203077 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.203981 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.205176 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.205611 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.205755 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:17.208895 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:17.208901 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:17.208901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:17.208916 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:17.211528 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:17.212022 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:17.212026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:17.212027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:17.212150 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:17.212469 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:17.212470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:17.212471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:17.212909 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:17.213008 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:17.213423 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 19:00:17.213598 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260809 19:00:17.213744 18806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:17.201171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:41457 (local address 127.23.229.1:58671)
0809 19:00:17.201298 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:17.201310 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:17.201380 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:17.202337 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:17.202338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:17.202728 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:17.202929 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:17.202935 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.204136 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.204137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:17.205075 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:17.205078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.205730 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.205731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:17.205864 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:17.206588 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:17.206593 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:17.208321 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:17.211994 (+ 3673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:17.211995 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:17.211995 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:17.212137 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:17.212442 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:17.212442 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:17.212443 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:17.212535 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:17.213017 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:17.213028 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:17.213199 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 19:00:17.213333 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 19:00:17.213618 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":64,"thread_start_us":55,"threads_started":1}
I20260809 19:00:17.214066 18809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:17.201192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:34031 (local address 127.23.229.1:53917)
0809 19:00:17.201327 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:17.201338 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:17.201406 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:17.202299 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:17.202302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:17.202728 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:17.202929 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:17.202936 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.204118 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.204120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:17.205077 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:17.205080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:17.205733 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:17.205734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:17.205861 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:17.206574 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:17.206584 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:17.208744 (+ 2160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:17.211634 (+ 2890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:17.211645 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:17.211647 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:17.211911 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:17.212260 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:17.212260 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:17.212261 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:17.212367 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:17.213016 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:17.213028 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:17.213199 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 19:00:17.213345 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 19:00:17.213676 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":246,"thread_start_us":61,"threads_started":1}
W20260809 19:00:17.214807 18207 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
W20260809 19:00:17.215081 18206 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
I20260809 19:00:17.215148 18206 leader_election.cc:302] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14ae486f98ce4290a37e25c4f361c196; no voters: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, 214c709c0e7f4f3390bcc209eea4b5aa
I20260809 19:00:17.215286 18805 raft_consensus.cc:2726] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 19:00:17.636350 18809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:17.636142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:55939)
0809 19:00:17.636261 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:17.636303 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 19:00:17.700655 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:17.700375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:50055)
0809 19:00:17.700557 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:17.700604 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":69,"threads_started":1}
I20260809 19:00:17.840543 18816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:17.840268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:45023)
0809 19:00:17.840406 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:17.840445 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260809 19:00:18.637246 18817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:18.636963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:35879)
0809 19:00:18.637151 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:18.637192 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":72,"threads_started":1}
I20260809 19:00:18.701407 18818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:18.701171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:34435)
0809 19:00:18.701307 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:18.701357 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260809 19:00:18.841262 18819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:18.841028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:38945)
0809 19:00:18.841174 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:18.841213 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260809 19:00:19.244014 18820 raft_consensus.cc:482] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:19.244136 18820 raft_consensus.cc:504] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 19:00:19.244406 18820 leader_election.cc:288] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457), 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
W20260809 19:00:19.244938 18206 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
W20260809 19:00:19.245013 18207 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
I20260809 19:00:19.245041 18206 leader_election.cc:302] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14ae486f98ce4290a37e25c4f361c196; no voters: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, 214c709c0e7f4f3390bcc209eea4b5aa
I20260809 19:00:19.245147 18820 raft_consensus.cc:2726] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 19:00:19.638104 18822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:19.637790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:48667)
0809 19:00:19.637977 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:19.638025 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":107,"threads_started":1}
I20260809 19:00:19.702288 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:19.701989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:38199)
0809 19:00:19.702168 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:19.702215 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":89,"threads_started":1}
I20260809 19:00:19.842041 18825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:19.841807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:37239)
0809 19:00:19.841954 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:19.841996 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
I20260809 19:00:20.639036 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:20.638768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:36165)
0809 19:00:20.638932 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:20.638983 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":74,"threads_started":1}
I20260809 19:00:20.703138 18829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:20.702878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:46891)
0809 19:00:20.703047 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:20.703090 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
I20260809 19:00:20.842818 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:20.842597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:57965)
0809 19:00:20.842730 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:20.842771 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260809 19:00:21.130335 18831 raft_consensus.cc:482] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:21.130458 18831 raft_consensus.cc:504] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 19:00:21.130679 18831 leader_election.cc:288] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457), 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
W20260809 19:00:21.131177 18207 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
W20260809 19:00:21.131263 18206 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
I20260809 19:00:21.131292 18207 leader_election.cc:302] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14ae486f98ce4290a37e25c4f361c196; no voters: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, 214c709c0e7f4f3390bcc209eea4b5aa
I20260809 19:00:21.131376 18831 raft_consensus.cc:2726] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 19:00:21.639864 18832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:21.639617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:52355)
0809 19:00:21.639765 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:21.639810 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":71,"threads_started":1}
I20260809 19:00:21.703994 18833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:21.703745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:36635)
0809 19:00:21.703890 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:21.703938 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260809 19:00:21.843683 18834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:21.843401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:43775)
0809 19:00:21.843551 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:21.843599 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
I20260809 19:00:22.640729 18836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:22.640379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:36249)
0809 19:00:22.640622 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:22.640672 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":76,"threads_started":1}
I20260809 19:00:22.704883 18837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:22.704629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:50547)
0809 19:00:22.704787 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:22.704831 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260809 19:00:22.844611 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:22.844237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:38037)
0809 19:00:22.844430 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:22.844556 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":76,"threads_started":1}
I20260809 19:00:23.025954 18839 raft_consensus.cc:482] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:23.026072 18839 raft_consensus.cc:504] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 19:00:23.026314 18839 leader_election.cc:288] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457), 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
W20260809 19:00:23.026755 18207 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
W20260809 19:00:23.026882 18206 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
I20260809 19:00:23.026973 18206 leader_election.cc:302] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14ae486f98ce4290a37e25c4f361c196; no voters: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, 214c709c0e7f4f3390bcc209eea4b5aa
I20260809 19:00:23.027066 18839 raft_consensus.cc:2726] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 19:00:23.641665 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:23.641377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:56369)
0809 19:00:23.641552 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:23.641611 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":73,"threads_started":1}
I20260809 19:00:23.705739 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:23.705462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:37951)
0809 19:00:23.705635 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:23.705681 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
I20260809 19:00:23.845327 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:23.845088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:50881)
0809 19:00:23.845240 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:23.845279 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260809 19:00:24.642542 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:24.642234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:47711)
0809 19:00:24.642431 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:24.642472 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
I20260809 19:00:24.706485 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:24.706257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:56421)
0809 19:00:24.706400 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:24.706434 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260809 19:00:24.846200 18848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:24.845944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:43695)
0809 19:00:24.846108 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:24.846148 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260809 19:00:25.643412 18851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.643117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:34741)
0809 19:00:25.643277 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.643345 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260809 19:00:25.707248 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.706977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:35305)
0809 19:00:25.707156 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.707197 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":109,"threads_started":1}
I20260809 19:00:25.846989 18854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.846742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:48015)
0809 19:00:25.846898 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.846937 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260809 19:00:26.644234 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.643960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:55703)
0809 19:00:26.644136 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.644180 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":75,"threads_started":1}
I20260809 19:00:26.708047 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.707788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:45715)
0809 19:00:26.707949 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.707994 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260809 19:00:26.847848 18859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.847604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:52107)
0809 19:00:26.847755 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.847795 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260809 19:00:27.645036 18860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:27.644766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:37333)
0809 19:00:27.644938 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:27.644982 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":74,"threads_started":1}
I20260809 19:00:27.708871 18861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:27.708654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:46289)
0809 19:00:27.708784 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:27.708821 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260809 19:00:27.848691 18862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:27.848412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:56901)
0809 19:00:27.848599 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:27.848639 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":128,"threads_started":1}
I20260809 19:00:28.163975 18864 raft_consensus.cc:482] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:28.164105 18864 raft_consensus.cc:504] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "214c709c0e7f4f3390bcc209eea4b5aa" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41457 } } peers { permanent_uuid: "097ca3dc5ecc4a9bb7e8e4b1ad527bf5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 34031 } } peers { permanent_uuid: "14ae486f98ce4290a37e25c4f361c196" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42739 } }
I20260809 19:00:28.164315 18864 leader_election.cc:288] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457), 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031)
W20260809 19:00:28.164783 18206 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 097ca3dc5ecc4a9bb7e8e4b1ad527bf5 (127.23.229.3:34031): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
W20260809 19:00:28.164899 18207 leader_election.cc:341] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 214c709c0e7f4f3390bcc209eea4b5aa (127.23.229.2:41457): Not found: Tablet not found: d5999b5762f547aba3d98d422e0c990f
I20260809 19:00:28.164984 18207 leader_election.cc:302] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14ae486f98ce4290a37e25c4f361c196; no voters: 097ca3dc5ecc4a9bb7e8e4b1ad527bf5, 214c709c0e7f4f3390bcc209eea4b5aa
I20260809 19:00:28.165077 18864 raft_consensus.cc:2726] T d5999b5762f547aba3d98d422e0c990f P 14ae486f98ce4290a37e25c4f361c196 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 19:00:28.645943 18865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:28.645641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:40215)
0809 19:00:28.645800 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:28.645887 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260809 19:00:28.709648 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:28.709399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:59663)
0809 19:00:28.709547 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:28.709595 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":68,"threads_started":1}
I20260809 19:00:28.849503 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:28.849254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:38209)
0809 19:00:28.849411 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:28.849453 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260809 19:00:29.646869 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:29.646569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:49711)
0809 19:00:29.646753 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:29.646797 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":131,"threads_started":1}
I20260809 19:00:29.710427 18873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:29.710174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:55531)
0809 19:00:29.710326 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:29.710376 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260809 19:00:29.850227 18875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:29.849969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:58265)
0809 19:00:29.850131 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:29.850174 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":68,"threads_started":1}
I20260809 19:00:30.647805 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:30.647540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.1:36225)
0809 19:00:30.647699 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:30.647750 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
I20260809 19:00:30.711233 18879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:30.711005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.2:50017)
0809 19:00:30.711146 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:30.711184 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260809 19:00:30.843317 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 18136
I20260809 19:00:30.854889 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:30.854677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42935 (local address 127.23.229.3:42617)
0809 19:00:30.854806 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:30.854842 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.62:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
I20260809 19:00:30.860162 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 18384
I20260809 19:00:30.874116 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 18587
2026-08-09T19:00:30Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58888 ms)
[----------] 30 tests from SecurityITest (243130 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:30 dist-test-slave-jq4t krb5kdc[18887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:30 dist-test-slave-jq4t krb5kdc[18887](info): set up 2 sockets
Aug 09 19:00:30 dist-test-slave-jq4t krb5kdc[18887](info): commencing operation
krb5kdc: starting...
W20260809 19:00:32.121340 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:00:32.246992 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43893
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43893
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:32.334753 18907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:32.334981 18907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:32.335005 18907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:32.336126 18907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:32.336162 18907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:32.336177 18907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:32.336189 18907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:32.336201 18907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:32.337707 18907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:32.337936 18907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:32.338121 18907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:32.343617 18916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:32.343714 18914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:32.343638 18919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:32.343638 18907 server_base.cc:1034] running on GCE node
I20260809 19:00:32.344147 18907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:32.344507 18907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:32.345693 18907 hybrid_clock.cc:648] HybridClock initialized: now 1786302032345672 us; error 34 us; skew 500 ppm
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:32.354270 18907 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:00:32.354784 18907 webserver.cc:460] Webserver started at http://127.23.229.62:38259/ using document root <none> and password file <none>
I20260809 19:00:32.355034 18907 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:32.355103 18907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:32.355262 18907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:32.356431 18907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "750b9774e6204f43aaaadad2ca7e5cdc"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "1988e6046e4de0a55808713b746b5111"
server_key_iv: "8a598f44fdbd90e1651b3db0c950686f"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.356901 18907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "750b9774e6204f43aaaadad2ca7e5cdc"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "1988e6046e4de0a55808713b746b5111"
server_key_iv: "8a598f44fdbd90e1651b3db0c950686f"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.358330 18907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 19:00:32.359177 18928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.359370 18907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:32.359488 18907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "750b9774e6204f43aaaadad2ca7e5cdc"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "1988e6046e4de0a55808713b746b5111"
server_key_iv: "8a598f44fdbd90e1651b3db0c950686f"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.359563 18907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:32.374889 18907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:32.377058 18907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:32.377236 18907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:32.381665 18907 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43893
I20260809 19:00:32.381707 19006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43893 every 8 connection(s)
I20260809 19:00:32.382254 18907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:32.382964 19007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:32.384156 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 18907
I20260809 19:00:32.384294 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:32.384558 24468 external_mini_cluster.cc:1428] Setting key 33a2cc2e4467ca8f72225b115e417b3b
I20260809 19:00:32.385838 19007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc: Bootstrap starting.
I20260809 19:00:32.386471 19007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:32.386847 19007 log.cc:824] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:32.387665 19007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc: No bootstrap required, opened a new log
I20260809 19:00:32.390050 19007 raft_consensus.cc:348] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43893 } }
I20260809 19:00:32.390244 19007 raft_consensus.cc:374] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:32.390283 19007 raft_consensus.cc:729] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 750b9774e6204f43aaaadad2ca7e5cdc, State: Initialized, Role: FOLLOWER
I20260809 19:00:32.390456 19007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43893 } }
I20260809 19:00:32.390581 19007 raft_consensus.cc:388] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:32.390630 19007 raft_consensus.cc:482] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:32.390687 19007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:32.391322 19007 raft_consensus.cc:504] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43893 } }
I20260809 19:00:32.391458 19007 leader_election.cc:302] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 750b9774e6204f43aaaadad2ca7e5cdc; no voters:
I20260809 19:00:32.391680 19007 leader_election.cc:288] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:32.391711 19013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:32.391858 19013 raft_consensus.cc:686] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [term 1 LEADER]: Becoming Leader. State: Replica: 750b9774e6204f43aaaadad2ca7e5cdc, State: Running, Role: LEADER
I20260809 19:00:32.392005 19013 consensus_queue.cc:237] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43893 } }
I20260809 19:00:32.392016 19007 sys_catalog.cc:564] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:32.392578 19015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43893 } } }
I20260809 19:00:32.392768 19015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:32.392712 19016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 750b9774e6204f43aaaadad2ca7e5cdc. Latest consensus state: current_term: 1 leader_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750b9774e6204f43aaaadad2ca7e5cdc" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43893 } } }
I20260809 19:00:32.393076 19016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:32.393433 19018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:32.394024 19018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:32.395781 19018 catalog_manager.cc:1347] Generated new cluster ID: 5002f879bca1477bb8dfa0cf2d9b4330
I20260809 19:00:32.395843 19018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:32.397552 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.385170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47008 (local address 127.23.229.62:43893)
0809 19:00:32.385369 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.385377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.385409 (+ 32us) server_negotiation.cc:407] Connection header received
0809 19:00:32.385805 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.385811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.385868 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.386046 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:32.386749 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.388176 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.389036 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.389759 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.389891 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.393196 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:32.393201 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:32.393202 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:32.393215 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:32.395306 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.395774 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.395778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.395778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.395933 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.396167 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.396168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.396169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.396518 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:32.396680 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.397176 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.397330 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260809 19:00:32.414686 19018 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:32.415279 19018 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:32.418272 19018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc: Generated new TSK 0
I20260809 19:00:32.418505 19018 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 19:00:32.451619 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43893
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:32.539146 19048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:32.539438 19048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:32.539486 19048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:32.540761 19048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:32.540844 19048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:32.540891 19048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 19:00:32.542522 19048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:32.542835 19048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:32.543100 19048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:32.548743 19057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:32.548715 19055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:32.548777 19048 server_base.cc:1034] running on GCE node
W20260809 19:00:32.548705 19054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:32.549144 19048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:32.549440 19048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:32.550585 19048 hybrid_clock.cc:648] HybridClock initialized: now 1786302032550561 us; error 42 us; skew 500 ppm
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:32.553352 19048 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 19:00:32.553788 19048 webserver.cc:460] Webserver started at http://127.23.229.1:35955/ using document root <none> and password file <none>
I20260809 19:00:32.554025 19048 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:32.554091 19048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:32.554244 19048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:32.555399 19048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "3d20b57479ea4133b26e5975b615263a"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "65e046bde73c57dcc9e9b1c05da9da1d"
server_key_iv: "a271f9f8947a498e6442fe32ff9985dc"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.555761 19048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "3d20b57479ea4133b26e5975b615263a"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "65e046bde73c57dcc9e9b1c05da9da1d"
server_key_iv: "a271f9f8947a498e6442fe32ff9985dc"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.557207 19048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:00:32.557933 19067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.558100 19048 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 19:00:32.558207 19048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "3d20b57479ea4133b26e5975b615263a"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "65e046bde73c57dcc9e9b1c05da9da1d"
server_key_iv: "a271f9f8947a498e6442fe32ff9985dc"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.558279 19048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:32.583709 19048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:32.589663 19048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:32.589848 19048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:32.590147 19048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:32.590602 19048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:32.590651 19048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.590685 19048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:32.590715 19048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.596935 19048 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:33289
I20260809 19:00:32.596978 19236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:33289 every 8 connection(s)
I20260809 19:00:32.597311 19048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:32.598397 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 19048
I20260809 19:00:32.598508 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 19:00:32.598696 24468 external_mini_cluster.cc:1428] Setting key 4fca6c97cd167df6e3c39bea7783f037
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
I20260809 19:00:32.608942 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.598040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:48397 (local address 127.23.229.62:43893)
0809 19:00:32.598088 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.598090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.598314 (+ 224us) server_negotiation.cc:407] Connection header received
0809 19:00:32.599087 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.599088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.599100 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.599177 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:32.600369 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.601182 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.602776 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.603129 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.603205 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.605552 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:32.605554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:32.605555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:32.605565 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:32.607277 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.607735 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.607737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.607737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.607808 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.608119 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.608121 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.608121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.608279 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:32.608369 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.608704 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.608812 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 19:00:32.609112 19244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.598001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43893 (local address 127.23.229.1:48397)
0809 19:00:32.598186 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:32.598230 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:32.598900 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:32.599275 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:32.599279 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:32.600040 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:32.600253 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.600259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.601300 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.601301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.602685 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.602688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.603212 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.603212 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.603317 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.603884 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:32.603894 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:32.605453 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:32.607396 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:32.607405 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:32.607408 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:32.607653 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:32.607912 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:32.607913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:32.607914 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:32.608039 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:32.608358 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:32.608363 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:32.608554 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 19:00:32.608658 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 19:00:32.608863 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":111,"threads_started":1}
I20260809 19:00:32.609664 19240 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43893
I20260809 19:00:32.609782 19240 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:32.609969 19240 heartbeater.cc:511] Master 127.23.229.62:43893 requested a full tablet report, sending...
I20260809 19:00:32.610563 18952 ts_manager.cc:194] Registered new tserver with Master: 3d20b57479ea4133b26e5975b615263a (127.23.229.1:33289)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
I20260809 19:00:32.611470 18952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:48397
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 19:00:32.625371 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43893
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:32.711396 19247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:32.711614 19247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:32.711639 19247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:32.712747 19247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:32.712782 19247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:32.712808 19247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 19:00:32.714210 19247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:32.714401 19247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:32.714597 19247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:32.719723 19259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:32.719794 19256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:32.719857 19255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:32.719957 19247 server_base.cc:1034] running on GCE node
I20260809 19:00:32.720187 19247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:32.720468 19247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:32.721644 19247 hybrid_clock.cc:648] HybridClock initialized: now 1786302032721635 us; error 28 us; skew 500 ppm
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:32.724206 19247 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 19:00:32.724699 19247 webserver.cc:460] Webserver started at http://127.23.229.2:43891/ using document root <none> and password file <none>
I20260809 19:00:32.724931 19247 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:32.724995 19247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:32.725142 19247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:32.726207 19247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "0ff2d909838a457c980647f6b9100664"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "9e1e44d5107ab54f8003eb5a4424c6ea"
server_key_iv: "bbfcab1865f5b18c8a4a4707da997a6e"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.726579 19247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "0ff2d909838a457c980647f6b9100664"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "9e1e44d5107ab54f8003eb5a4424c6ea"
server_key_iv: "bbfcab1865f5b18c8a4a4707da997a6e"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.727941 19247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:32.728683 19269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.728838 19247 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:32.728957 19247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "0ff2d909838a457c980647f6b9100664"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "9e1e44d5107ab54f8003eb5a4424c6ea"
server_key_iv: "bbfcab1865f5b18c8a4a4707da997a6e"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.729033 19247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:32.746127 19247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:32.748389 19247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:32.748591 19247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:32.748838 19247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:32.749184 19247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:32.749221 19247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.749243 19247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:32.749272 19247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.755283 19247 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:38205
I20260809 19:00:32.755347 19435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:38205 every 8 connection(s)
I20260809 19:00:32.755673 19247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:32.761022 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 19247
I20260809 19:00:32.761176 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 19:00:32.761423 24468 external_mini_cluster.cc:1428] Setting key b4346eff3a509f65aa29c1706e0eecc0
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:32.766376 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.756472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:38225 (local address 127.23.229.62:43893)
0809 19:00:32.756583 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.756585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.756779 (+ 194us) server_negotiation.cc:407] Connection header received
0809 19:00:32.757363 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.757365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.757379 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.757445 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:32.758495 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.759022 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.760157 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.760533 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.760625 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.763354 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:32.763356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:32.763356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:32.763364 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:32.764881 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.765382 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.765383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.765383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.765433 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.765740 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.765741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.765741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.765844 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:32.765896 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.766234 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.766310 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:00:32.766695 19441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.756438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43893 (local address 127.23.229.2:38225)
0809 19:00:32.756648 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:32.756688 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:32.757241 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:32.757527 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:32.757532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:32.758144 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:32.758385 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.758391 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.759126 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.759127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.760038 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.760041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.760648 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.760649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.760807 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.761444 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:32.761455 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:32.763233 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:32.764960 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:32.764968 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:32.764970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:32.765304 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:32.765501 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:32.765502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:32.765503 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:32.765651 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:32.765907 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:32.765915 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:32.766090 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 19:00:32.766218 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 19:00:32.766410 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":109,"threads_started":1}
I20260809 19:00:32.767235 19439 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43893
I20260809 19:00:32.767354 19439 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:32.767585 19439 heartbeater.cc:511] Master 127.23.229.62:43893 requested a full tablet report, sending...
I20260809 19:00:32.768116 18952 ts_manager.cc:194] Registered new tserver with Master: 0ff2d909838a457c980647f6b9100664 (127.23.229.2:38205)
I20260809 19:00:32.768651 18952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:38225
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 19:00:32.787184 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43893
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:32.872840 19445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:32.873081 19445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:32.873104 19445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:32.874244 19445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:32.874290 19445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:32.874341 19445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 19:00:32.875823 19445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:43893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:32.876066 19445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:32.876307 19445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:32.881469 19454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:32.881538 19456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:32.881654 19453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:32.881685 19445 server_base.cc:1034] running on GCE node
I20260809 19:00:32.881917 19445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:32.882198 19445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:32.883343 19445 hybrid_clock.cc:648] HybridClock initialized: now 1786302032883322 us; error 39 us; skew 500 ppm
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:32.885994 19445 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 19:00:32.886377 19445 webserver.cc:460] Webserver started at http://127.23.229.3:37855/ using document root <none> and password file <none>
I20260809 19:00:32.886592 19445 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:32.886634 19445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:32.886727 19445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:32.887733 19445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "f027844675224550b7075a8e9b3578a5"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "48746e7c74434570ab246de0308a5e51"
server_key_iv: "cde4ded7689ecedf0b7889bf4f533c12"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.888039 19445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "f027844675224550b7075a8e9b3578a5"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "48746e7c74434570ab246de0308a5e51"
server_key_iv: "cde4ded7689ecedf0b7889bf4f533c12"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.889392 19445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:32.890076 19465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.890256 19445 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:32.890341 19445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "f027844675224550b7075a8e9b3578a5"
format_stamp: "Formatted at 2026-08-09 19:00:32 on dist-test-slave-jq4t"
server_key: "48746e7c74434570ab246de0308a5e51"
server_key_iv: "cde4ded7689ecedf0b7889bf4f533c12"
server_key_version: "encryptionkey@0"
I20260809 19:00:32.890407 19445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:32.903479 19445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:32.906423 19445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:32.906576 19445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:32.906810 19445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:32.907145 19445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:32.907181 19445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.907226 19445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:32.907255 19445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:32.914667 19445 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:39749
I20260809 19:00:32.914713 19633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:39749 every 8 connection(s)
I20260809 19:00:32.915062 19445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 19:00:32 dist-test-slave-jq4t krb5kdc[18887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302032, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:32.923071 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 19445
I20260809 19:00:32.923197 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 19:00:32.923418 24468 external_mini_cluster.cc:1428] Setting key 625e44565e696f5a810e47ca1aa0747b
I20260809 19:00:32.925141 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.915933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:45643 (local address 127.23.229.62:43893)
0809 19:00:32.916027 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.916029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.916240 (+ 211us) server_negotiation.cc:407] Connection header received
0809 19:00:32.916861 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.916863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.916877 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.916927 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:32.917903 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.918481 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.919513 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.919729 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.919804 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.922058 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:32.922060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:32.922060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:32.922068 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:32.923534 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.924052 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.924053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.924053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.924118 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.924420 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.924421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.924422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.924604 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:32.924643 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.924940 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.925038 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 19:00:32.925362 19637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.915901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:43893 (local address 127.23.229.3:45643)
0809 19:00:32.916098 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:32.916143 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:32.916748 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:32.916998 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:32.917002 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:32.917598 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:32.917802 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.917806 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.918581 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.918582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.919398 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.919400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.919812 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.919813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.919955 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.920586 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:32.920595 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:32.921959 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:32.923645 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:32.923653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:32.923655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:32.923989 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:32.924194 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:32.924195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:32.924195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:32.924338 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:32.924683 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:32.924689 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:32.924812 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 19:00:32.924958 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 19:00:32.925138 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
I20260809 19:00:32.925879 19635 heartbeater.cc:347] Connected to a master server at 127.23.229.62:43893
I20260809 19:00:32.926007 19635 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:32.926196 19635 heartbeater.cc:511] Master 127.23.229.62:43893 requested a full tablet report, sending...
I20260809 19:00:32.926599 18952 ts_manager.cc:194] Registered new tserver with Master: f027844675224550b7075a8e9b3578a5 (127.23.229.3:39749)
I20260809 19:00:32.926982 18952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:45643
I20260809 19:00:32.935326 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:32.944820 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.937178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47020 (local address 127.23.229.62:43893)
0809 19:00:32.937247 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.937249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.937376 (+ 127us) server_negotiation.cc:407] Connection header received
0809 19:00:32.937444 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.937445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.937460 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.937508 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:32.938313 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.938793 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.940152 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.940340 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.940395 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.942070 (+ 1675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:32.942071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:32.942071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:32.942078 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:32.943509 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.943968 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.943969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.943970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.944032 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:32.944254 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:32.944255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:32.944255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:32.944414 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:32.944552 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.944683 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.944750 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 19:00:32.946743 18952 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:32.949783 18952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:32.957996 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.952428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:33289 (local address 127.0.0.1:42174)
0809 19:00:32.953453 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:32.953463 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:32.953517 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:32.953777 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:32.953778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:32.953779 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:32.953807 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.953808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.955174 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.955174 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.956623 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.956626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.957678 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.957678 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.957766 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.957782 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 19:00:32.957849 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 19:00:32.957911 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1005,"mutex_wait_us":29,"thread_start_us":112,"threads_started":1}
I20260809 19:00:32.958021 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.952791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47610 (local address 127.23.229.3:39749)
0809 19:00:32.952988 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.952992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.953682 (+ 690us) server_negotiation.cc:407] Connection header received
0809 19:00:32.953745 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.953748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.953770 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.953877 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:32.954130 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.955429 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.956799 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.957514 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.957570 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.957639 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.957895 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.957936 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":90,"threads_started":1}
I20260809 19:00:32.958453 19657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.952940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42174 (local address 127.23.229.1:33289)
0809 19:00:32.953262 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.953266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.953514 (+ 248us) server_negotiation.cc:407] Connection header received
0809 19:00:32.953588 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.953591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.953608 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.953688 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:32.953892 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.955056 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.956731 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.957522 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.957586 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.957639 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.958329 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.958376 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":95,"threads_started":1}
I20260809 19:00:32.958254 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.952671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:39749 (local address 127.0.0.1:47610)
0809 19:00:32.953596 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:32.953604 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:32.953652 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:32.953976 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:32.953977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:32.953980 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:32.954036 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.954037 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.955587 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.955587 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.956702 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.956704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.957697 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.957697 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.957766 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.957782 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 19:00:32.958139 (+ 357us) client_negotiation.cc:240] Negotiation successful
0809 19:00:32.958199 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"thread_start_us":73,"threads_started":1}
I20260809 19:00:32.959401 19535 tablet_service.cc:1467] Processing CreateTablet for tablet bd3025005d41453f8f7202afe544cd3e (DEFAULT_TABLE table=test-table [id=e68b523723e34337b8f5d45bb27d5e52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:32.959506 19142 tablet_service.cc:1467] Processing CreateTablet for tablet bd3025005d41453f8f7202afe544cd3e (DEFAULT_TABLE table=test-table [id=e68b523723e34337b8f5d45bb27d5e52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:32.959662 19648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.952426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:38205 (local address 127.0.0.1:60818)
0809 19:00:32.952975 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:32.953024 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:32.953104 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:32.953722 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:32.953724 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:32.953726 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:32.953805 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.953807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.955173 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.955174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.958243 (+ 3069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:32.958246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.959418 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.959419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:32.959488 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.959493 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:00:32.959548 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 19:00:32.959592 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":1208,"thread_start_us":92,"threads_started":1}
I20260809 19:00:32.959815 19535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3025005d41453f8f7202afe544cd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:32.959916 19653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:32.952649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60818 (local address 127.23.229.2:38205)
0809 19:00:32.952900 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:32.952904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:32.953193 (+ 289us) server_negotiation.cc:407] Connection header received
0809 19:00:32.953244 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:32.953247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:32.953266 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:32.953337 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:32.953894 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.955056 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.958340 (+ 3284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:32.959246 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:32.959321 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:32.959378 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:32.959767 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 19:00:32.959813 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":104,"threads_started":1}
I20260809 19:00:32.959925 19142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3025005d41453f8f7202afe544cd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:32.960721 19342 tablet_service.cc:1467] Processing CreateTablet for tablet bd3025005d41453f8f7202afe544cd3e (DEFAULT_TABLE table=test-table [id=e68b523723e34337b8f5d45bb27d5e52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:32.961084 19342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3025005d41453f8f7202afe544cd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:32.962976 19658 tablet_bootstrap.cc:492] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Bootstrap starting.
I20260809 19:00:32.963541 19659 tablet_bootstrap.cc:492] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a: Bootstrap starting.
I20260809 19:00:32.963922 19658 tablet_bootstrap.cc:654] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:32.964290 19659 tablet_bootstrap.cc:654] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:32.964708 19658 log.cc:824] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:32.964979 19659 log.cc:824] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:32.965351 19660 tablet_bootstrap.cc:492] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: Bootstrap starting.
I20260809 19:00:32.965814 19659 tablet_bootstrap.cc:492] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a: No bootstrap required, opened a new log
I20260809 19:00:32.965895 19659 ts_tablet_manager.cc:1397] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:32.966008 19660 tablet_bootstrap.cc:654] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:32.966542 19660 log.cc:824] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:32.967335 19658 tablet_bootstrap.cc:492] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: No bootstrap required, opened a new log
I20260809 19:00:32.967396 19660 tablet_bootstrap.cc:492] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: No bootstrap required, opened a new log
I20260809 19:00:32.967460 19658 ts_tablet_manager.cc:1397] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 19:00:32.967546 19660 ts_tablet_manager.cc:1397] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:32.968139 19659 raft_consensus.cc:348] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:32.968327 19659 raft_consensus.cc:374] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:32.968364 19659 raft_consensus.cc:729] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d20b57479ea4133b26e5975b615263a, State: Initialized, Role: FOLLOWER
I20260809 19:00:32.968530 19659 consensus_queue.cc:260] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:32.968822 19659 ts_tablet_manager.cc:1428] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 19:00:32.969142 19240 heartbeater.cc:503] Master 127.23.229.62:43893 was elected leader, sending a full tablet report...
I20260809 19:00:32.969605 19658 raft_consensus.cc:348] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:32.969765 19658 raft_consensus.cc:374] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:32.969800 19658 raft_consensus.cc:729] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f027844675224550b7075a8e9b3578a5, State: Initialized, Role: FOLLOWER
I20260809 19:00:32.969925 19658 consensus_queue.cc:260] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:32.970260 19658 ts_tablet_manager.cc:1428] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 19:00:32.970422 19635 heartbeater.cc:503] Master 127.23.229.62:43893 was elected leader, sending a full tablet report...
I20260809 19:00:32.970666 19660 raft_consensus.cc:348] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:32.970938 19660 raft_consensus.cc:374] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:32.971035 19660 raft_consensus.cc:729] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ff2d909838a457c980647f6b9100664, State: Initialized, Role: FOLLOWER
I20260809 19:00:32.971225 19660 consensus_queue.cc:260] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:32.971556 19660 ts_tablet_manager.cc:1428] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 19:00:32.971563 19439 heartbeater.cc:503] Master 127.23.229.62:43893 was elected leader, sending a full tablet report...
I20260809 19:00:33.002954 19670 raft_consensus.cc:482] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:33.003140 19670 raft_consensus.cc:504] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:33.003585 19670 leader_election.cc:288] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d20b57479ea4133b26e5975b615263a (127.23.229.1:33289), f027844675224550b7075a8e9b3578a5 (127.23.229.3:39749)
W20260809 19:00:33.006202 19440 tablet.cc:2369] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:33.007634 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.004026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:43415 (local address 127.23.229.3:39749)
0809 19:00:33.004092 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.004095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.004226 (+ 131us) server_negotiation.cc:407] Connection header received
0809 19:00:33.004297 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.004298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.004308 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.004359 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:33.004530 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.005218 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.006538 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.007127 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.007208 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.007218 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.007518 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.007561 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 19:00:33.007634 19657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.003893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:38981 (local address 127.23.229.1:33289)
0809 19:00:33.003946 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.003948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.003958 (+ 10us) server_negotiation.cc:407] Connection header received
0809 19:00:33.004009 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.004011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.004025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.004099 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:33.004292 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.005091 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.006532 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.007127 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.007209 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.007218 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.007518 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.007561 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 19:00:33.007654 19441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.003804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:33289 (local address 127.23.229.2:38981)
0809 19:00:33.003881 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.003894 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.003951 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.004130 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.004132 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.004134 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:33.004221 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.004223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.005184 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.005185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.006434 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.006437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.007296 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.007297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.007420 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.007423 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.007496 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.007542 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":37}
I20260809 19:00:33.007663 19674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.003948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:39749 (local address 127.23.229.2:43415)
0809 19:00:33.004157 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.004167 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.004226 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.004376 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.004376 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.004378 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:33.004433 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.004434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.005311 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.005312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.006434 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.006437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.007296 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.007297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.007406 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.007418 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.007502 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.007543 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":3,"thread_start_us":128,"threads_started":1}
I20260809 19:00:33.008049 19164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3025005d41453f8f7202afe544cd3e" candidate_uuid: "0ff2d909838a457c980647f6b9100664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d20b57479ea4133b26e5975b615263a" is_pre_election: true
I20260809 19:00:33.008245 19164 raft_consensus.cc:2454] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ff2d909838a457c980647f6b9100664 in term 0.
I20260809 19:00:33.008312 19565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3025005d41453f8f7202afe544cd3e" candidate_uuid: "0ff2d909838a457c980647f6b9100664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f027844675224550b7075a8e9b3578a5" is_pre_election: true
I20260809 19:00:33.008496 19565 raft_consensus.cc:2454] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ff2d909838a457c980647f6b9100664 in term 0.
I20260809 19:00:33.008502 19274 leader_election.cc:302] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ff2d909838a457c980647f6b9100664, 3d20b57479ea4133b26e5975b615263a; no voters:
I20260809 19:00:33.008630 19670 raft_consensus.cc:2781] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:33.008688 19670 raft_consensus.cc:482] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:33.008711 19670 raft_consensus.cc:3037] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:33.009431 19670 raft_consensus.cc:504] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:33.009562 19670 leader_election.cc:288] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [CANDIDATE]: Term 1 election: Requested vote from peers 3d20b57479ea4133b26e5975b615263a (127.23.229.1:33289), f027844675224550b7075a8e9b3578a5 (127.23.229.3:39749)
I20260809 19:00:33.009750 19164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3025005d41453f8f7202afe544cd3e" candidate_uuid: "0ff2d909838a457c980647f6b9100664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d20b57479ea4133b26e5975b615263a"
I20260809 19:00:33.009752 19565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3025005d41453f8f7202afe544cd3e" candidate_uuid: "0ff2d909838a457c980647f6b9100664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f027844675224550b7075a8e9b3578a5"
I20260809 19:00:33.009829 19565 raft_consensus.cc:3037] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:33.009837 19164 raft_consensus.cc:3037] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:33.010720 19565 raft_consensus.cc:2454] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ff2d909838a457c980647f6b9100664 in term 1.
I20260809 19:00:33.010720 19164 raft_consensus.cc:2454] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ff2d909838a457c980647f6b9100664 in term 1.
I20260809 19:00:33.010891 19274 leader_election.cc:302] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ff2d909838a457c980647f6b9100664, 3d20b57479ea4133b26e5975b615263a; no voters:
I20260809 19:00:33.010983 19670 raft_consensus.cc:2781] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:33.011142 19670 raft_consensus.cc:686] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 1 LEADER]: Becoming Leader. State: Replica: 0ff2d909838a457c980647f6b9100664, State: Running, Role: LEADER
I20260809 19:00:33.011255 19670 consensus_queue.cc:237] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } }
I20260809 19:00:33.012109 18952 catalog_manager.cc:5495] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ff2d909838a457c980647f6b9100664 (127.23.229.2). New cstate: current_term: 1 leader_uuid: "0ff2d909838a457c980647f6b9100664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ff2d909838a457c980647f6b9100664" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 38205 } health_report { overall_health: HEALTHY } } }
I20260809 19:00:33.019130 19653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.016738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60824 (local address 127.23.229.2:38205)
0809 19:00:33.016780 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.016782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.016791 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:00:33.016878 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.016878 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.016898 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.016980 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:33.017112 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.017577 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.018342 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.018544 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.018615 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.018779 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:33.018886 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:33.018970 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.019010 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.019031 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 19:00:33.020992 19164 raft_consensus.cc:1261] T bd3025005d41453f8f7202afe544cd3e P 3d20b57479ea4133b26e5975b615263a [term 1 FOLLOWER]: Refusing update from remote peer 0ff2d909838a457c980647f6b9100664: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:33.020996 19565 raft_consensus.cc:1261] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 1 FOLLOWER]: Refusing update from remote peer 0ff2d909838a457c980647f6b9100664: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:33.021387 19670 consensus_queue.cc:1035] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d20b57479ea4133b26e5975b615263a" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 33289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:33.021529 19675 consensus_queue.cc:1035] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f027844675224550b7075a8e9b3578a5" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:33.024349 19681 mvcc.cc:205] Tried to move back new op lower bound from 7316693127250894848 to 7316693127214747648. Current Snapshot: MvccSnapshot[applied={T|T < 7316693127250894848}]
I20260809 19:00:33.024539 19683 mvcc.cc:205] Tried to move back new op lower bound from 7316693127250894848 to 7316693127214747648. Current Snapshot: MvccSnapshot[applied={T|T < 7316693127250894848}]
I20260809 19:00:33.026782 18952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:33.026885 18952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:33.027628 18952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 750b9774e6204f43aaaadad2ca7e5cdc: Sending DeleteTablet for 3 replicas of tablet bd3025005d41453f8f7202afe544cd3e
I20260809 19:00:33.027953 19142 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3025005d41453f8f7202afe544cd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:33 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:42174
I20260809 19:00:33.027989 19342 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3025005d41453f8f7202afe544cd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:33 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:60818
I20260809 19:00:33.028180 19535 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3025005d41453f8f7202afe544cd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:33 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:47610
I20260809 19:00:33.028270 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 19048
I20260809 19:00:33.042204 19698 tablet_replica.cc:330] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: stopping tablet replica
I20260809 19:00:33.042390 19698 raft_consensus.cc:2229] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:33.042588 19698 raft_consensus.cc:2258] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:33.042793 19697 tablet_replica.cc:330] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: stopping tablet replica
I20260809 19:00:33.042941 19697 raft_consensus.cc:2229] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:33.043087 19697 raft_consensus.cc:2258] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:33.043104 19698 ts_tablet_manager.cc:1905] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:33.044987 19698 ts_tablet_manager.cc:1918] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:33.045140 19698 log.cc:1196] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/bd3025005d41453f8f7202afe544cd3e
I20260809 19:00:33.045532 19698 ts_tablet_manager.cc:1939] T bd3025005d41453f8f7202afe544cd3e P f027844675224550b7075a8e9b3578a5: Deleting consensus metadata
I20260809 19:00:33.046121 18932 catalog_manager.cc:4841] TS f027844675224550b7075a8e9b3578a5 (127.23.229.3:39749): tablet bd3025005d41453f8f7202afe544cd3e (table test-table [id=e68b523723e34337b8f5d45bb27d5e52]) successfully deleted
W20260809 19:00:33.047514 18932 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:33289 (error 108)
I20260809 19:00:33.047848 19697 ts_tablet_manager.cc:1905] T bd3025005d41453f8f7202afe544cd3e P 0ff2d909838a457c980647f6b9100664: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:33.047917 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 19247
I20260809 19:00:33.057130 19648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.057008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:33289 (local address 127.0.0.1:42188)
0809 19:00:33.057054 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.057094 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:33289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260809 19:00:33.057310 18932 catalog_manager.cc:4584] TS 3d20b57479ea4133b26e5975b615263a (127.23.229.1:33289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd3025005d41453f8f7202afe544cd3e: Network error: Client connection negotiation failed: client connection to 127.23.229.1:33289: connect: Connection refused (error 111)
I20260809 19:00:33.062136 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 19445
I20260809 19:00:33.062260 19648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.062102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:38205 (local address 127.0.0.1:60840)
0809 19:00:33.062178 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.062208 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.2:38205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 19:00:33.076283 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 18907
2026-08-09T19:00:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2204 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T19:00:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:33Z Disabled control of system clock
I20260809 19:00:33.112123 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38845
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:38845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:33.196254 19704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:33.196544 19704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:33.196584 19704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:33.197773 19704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:33.197845 19704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:33.197868 19704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:33.197888 19704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:33.197923 19704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:33.199317 19704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:38845
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:38845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:33.199620 19704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:33.199927 19704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:33.205166 19712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:33.205166 19715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:33.205202 19713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:33.205291 19704 server_base.cc:1034] running on GCE node
I20260809 19:00:33.205684 19704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:33.206008 19704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:33.207202 19704 hybrid_clock.cc:648] HybridClock initialized: now 1786302033207182 us; error 41 us; skew 500 ppm
I20260809 19:00:33.208691 19704 webserver.cc:460] Webserver started at http://127.23.229.62:43699/ using document root <none> and password file <none>
I20260809 19:00:33.208961 19704 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:33.209033 19704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:33.209180 19704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:33.210296 19704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "1473a4dcf6d0426fa582830b3491e3e1"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "ab4890fa28b9af4c40ed437543ed3ae5"
server_key_iv: "444240b4447dcf318c19e5c8f880f1ce"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.210676 19704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "1473a4dcf6d0426fa582830b3491e3e1"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "ab4890fa28b9af4c40ed437543ed3ae5"
server_key_iv: "444240b4447dcf318c19e5c8f880f1ce"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.212073 19704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:33.212854 19723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.213045 19704 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.213152 19704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "1473a4dcf6d0426fa582830b3491e3e1"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "ab4890fa28b9af4c40ed437543ed3ae5"
server_key_iv: "444240b4447dcf318c19e5c8f880f1ce"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.213227 19704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:33.233827 19704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:33.234218 19704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:33.234378 19704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:33.238862 19704 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:38845
I20260809 19:00:33.238900 19808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:38845 every 8 connection(s)
I20260809 19:00:33.239305 19704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:33.240334 19809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:33.242774 19809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1: Bootstrap starting.
I20260809 19:00:33.243340 19809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:33.243615 19809 log.cc:824] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:33.244282 19809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1: No bootstrap required, opened a new log
I20260809 19:00:33.245929 19809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1473a4dcf6d0426fa582830b3491e3e1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38845 } }
I20260809 19:00:33.246073 19809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:33.246095 19809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1473a4dcf6d0426fa582830b3491e3e1, State: Initialized, Role: FOLLOWER
I20260809 19:00:33.246203 19809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1473a4dcf6d0426fa582830b3491e3e1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38845 } }
I20260809 19:00:33.246258 19809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:33.246277 19809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:33.246352 19809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:33.246894 19809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1473a4dcf6d0426fa582830b3491e3e1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38845 } }
I20260809 19:00:33.246994 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 19704
I20260809 19:00:33.246985 19809 leader_election.cc:302] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1473a4dcf6d0426fa582830b3491e3e1; no voters:
I20260809 19:00:33.247114 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:33.247210 19809 leader_election.cc:288] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:33.247258 19816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:33.247355 24468 external_mini_cluster.cc:1428] Setting key 8162bad0029385666ac7695f69c710cf
I20260809 19:00:33.247473 19816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 1473a4dcf6d0426fa582830b3491e3e1, State: Running, Role: LEADER
I20260809 19:00:33.247503 19809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:33.247577 19816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1473a4dcf6d0426fa582830b3491e3e1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38845 } }
I20260809 19:00:33.248077 19817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1473a4dcf6d0426fa582830b3491e3e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1473a4dcf6d0426fa582830b3491e3e1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38845 } } }
I20260809 19:00:33.248170 19817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:33.248333 19818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1473a4dcf6d0426fa582830b3491e3e1. Latest consensus state: current_term: 1 leader_uuid: "1473a4dcf6d0426fa582830b3491e3e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1473a4dcf6d0426fa582830b3491e3e1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 38845 } } }
I20260809 19:00:33.248430 19818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:33.248531 19828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:33.249096 19828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:33.250677 19828 catalog_manager.cc:1347] Generated new cluster ID: 8125e89b9b5941a9baa52a7753dc0098
I20260809 19:00:33.250746 19828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:33.254568 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.248025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49782 (local address 127.23.229.62:38845)
0809 19:00:33.248651 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.248661 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.248703 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:00:33.248845 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.248853 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.248950 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.249455 (+ 505us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:33.249559 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.250977 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.252136 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.252800 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.252944 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.253809 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:33.253815 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:33.253815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:33.254058 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:33.254101 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:33.254116 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:33.254188 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.254254 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.254344 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":460,"threads_started":1}
I20260809 19:00:33.264371 19828 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:33.264957 19828 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:33.269579 19828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1: Generated new TSK 0
I20260809 19:00:33.269790 19828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:33.272429 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38845
--builtin_ntp_servers=127.23.229.20:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:33.358011 19842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:33.358214 19842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:33.358237 19842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:33.359462 19842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:33.359509 19842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:33.359561 19842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 19:00:33.361068 19842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:33.361340 19842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:33.361665 19842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:33.366778 19848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:33.366779 19849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:33.366885 19851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:33.367075 19842 server_base.cc:1034] running on GCE node
I20260809 19:00:33.367306 19842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:33.367576 19842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:33.368726 19842 hybrid_clock.cc:648] HybridClock initialized: now 1786302033368705 us; error 40 us; skew 500 ppm
I20260809 19:00:33.370182 19842 webserver.cc:460] Webserver started at http://127.23.229.1:35581/ using document root <none> and password file <none>
I20260809 19:00:33.370460 19842 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:33.370532 19842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:33.370689 19842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:33.371802 19842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "f17ccfc7461141f0b99d310d401b450e"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "8b552bec2357abbd87f2518833f9a232"
server_key_iv: "7d9a98c88071b3e5d7eeb4bc3847e59b"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.372179 19842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "f17ccfc7461141f0b99d310d401b450e"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "8b552bec2357abbd87f2518833f9a232"
server_key_iv: "7d9a98c88071b3e5d7eeb4bc3847e59b"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.373684 19842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:33.374527 19858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.374776 19842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:33.374887 19842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "f17ccfc7461141f0b99d310d401b450e"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "8b552bec2357abbd87f2518833f9a232"
server_key_iv: "7d9a98c88071b3e5d7eeb4bc3847e59b"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.374967 19842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:33.389317 19842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:33.389628 19842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:33.389736 19842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:33.389943 19842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:33.390316 19842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:33.390353 19842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.390398 19842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:33.390424 19842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.396445 19842 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:45105
I20260809 19:00:33.396556 20036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:45105 every 8 connection(s)
I20260809 19:00:33.396937 19842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:33.398280 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 19842
I20260809 19:00:33.398365 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 19:00:33.398571 24468 external_mini_cluster.cc:1428] Setting key a17f01c6097d8197add87ba219d38818
I20260809 19:00:33.399607 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38845
--builtin_ntp_servers=127.23.229.20:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:00:33.403296 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.397719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:37449 (local address 127.23.229.62:38845)
0809 19:00:33.397781 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.397783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.398047 (+ 264us) server_negotiation.cc:407] Connection header received
0809 19:00:33.398709 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.398710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.398729 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.398798 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:33.399702 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.400513 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.401778 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.401985 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.402042 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.403033 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:33.403035 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:33.403035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:33.403040 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:33.403056 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:33.403060 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:33.403104 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.403204 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.403235 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 19:00:33.403821 20039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.397708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38845 (local address 127.23.229.1:37449)
0809 19:00:33.397917 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.397958 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.398561 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.398898 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.398902 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.398913 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:33.399604 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.399610 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.400597 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.400597 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.401693 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.401696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.402071 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.402072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.402241 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.402861 (+ 620us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:33.402862 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:33.402901 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:33.402931 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:33.403121 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:33.403128 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:33.403131 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.403203 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.403322 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260809 19:00:33.404554 20037 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38845
I20260809 19:00:33.404671 20037 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:33.404910 20037 heartbeater.cc:511] Master 127.23.229.62:38845 requested a full tablet report, sending...
I20260809 19:00:33.405493 19747 ts_manager.cc:194] Registered new tserver with Master: f17ccfc7461141f0b99d310d401b450e (127.23.229.1:45105)
I20260809 19:00:33.406147 19747 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.1:37449
W20260809 19:00:33.487615 20041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:33.487826 20041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:33.487848 20041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:33.489044 20041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:33.489085 20041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:33.489135 20041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 19:00:33.490504 20041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:33.490741 20041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:33.491052 20041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:33.496179 20051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:33.496315 20041 server_base.cc:1034] running on GCE node
W20260809 19:00:33.496170 20050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:33.496203 20054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:33.496613 20041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:33.496886 20041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:33.498049 20041 hybrid_clock.cc:648] HybridClock initialized: now 1786302033498048 us; error 39 us; skew 500 ppm
I20260809 19:00:33.499248 20041 webserver.cc:460] Webserver started at http://127.23.229.2:38599/ using document root <none> and password file <none>
I20260809 19:00:33.499496 20041 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:33.499564 20041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:33.499715 20041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:33.500840 20041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "2786f43698c84d48b43250ee8b2c91c8"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "9018d9f70f043b3730df65e9ad5dbb3c"
server_key_iv: "59906b3f9825073197cee30347934179"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.501200 20041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "2786f43698c84d48b43250ee8b2c91c8"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "9018d9f70f043b3730df65e9ad5dbb3c"
server_key_iv: "59906b3f9825073197cee30347934179"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.502513 20041 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:33.503279 20064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.503477 20041 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:33.503583 20041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "2786f43698c84d48b43250ee8b2c91c8"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "9018d9f70f043b3730df65e9ad5dbb3c"
server_key_iv: "59906b3f9825073197cee30347934179"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.503656 20041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:33.519706 20041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:33.520011 20041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:33.520120 20041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:33.520315 20041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:33.520718 20041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:33.520756 20041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.520780 20041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:33.520793 20041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.526592 20041 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:44779
I20260809 19:00:33.526643 20240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:44779 every 8 connection(s)
I20260809 19:00:33.526997 20041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:33.532390 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.527735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:50603 (local address 127.23.229.62:38845)
0809 19:00:33.527809 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.527822 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.528052 (+ 230us) server_negotiation.cc:407] Connection header received
0809 19:00:33.528615 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.528617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.528631 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.528696 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:33.529394 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.529912 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.530906 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.531119 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.531201 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.532071 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:33.532073 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:33.532073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:33.532079 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:33.532095 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:33.532099 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:33.532171 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.532276 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.532308 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 19:00:33.532624 20243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.527727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38845 (local address 127.23.229.2:50603)
0809 19:00:33.527913 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.527958 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.528502 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.528770 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.528774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.528788 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:33.529303 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.529308 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.530019 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.530020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.530816 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.530818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.531216 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.531217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.531355 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.531919 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:33.531920 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:33.531955 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:33.531979 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:33.532175 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:33.532182 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:33.532185 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.532263 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.532372 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260809 19:00:33.533083 20241 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38845
I20260809 19:00:33.533178 20241 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:33.533325 20241 heartbeater.cc:511] Master 127.23.229.62:38845 requested a full tablet report, sending...
I20260809 19:00:33.533676 19747 ts_manager.cc:194] Registered new tserver with Master: 2786f43698c84d48b43250ee8b2c91c8 (127.23.229.2:44779)
I20260809 19:00:33.534016 19747 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.2:50603
I20260809 19:00:33.536520 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 20041
I20260809 19:00:33.536617 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 19:00:33.536778 24468 external_mini_cluster.cc:1428] Setting key ba32f3dd252e111d1af54fc387779116
I20260809 19:00:33.537637 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38845
--builtin_ntp_servers=127.23.229.20:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:33.622212 20244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:33.622474 20244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:33.622511 20244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:33.623649 20244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:33.623715 20244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:33.623755 20244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 19:00:33.625115 20244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:38845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:33.625396 20244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:33.625707 20244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:33.630913 20254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:33.630966 20252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:33.630928 20257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:33.631112 20244 server_base.cc:1034] running on GCE node
I20260809 19:00:33.631325 20244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:33.631562 20244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:33.632726 20244 hybrid_clock.cc:648] HybridClock initialized: now 1786302033632721 us; error 55 us; skew 500 ppm
I20260809 19:00:33.633962 20244 webserver.cc:460] Webserver started at http://127.23.229.3:33873/ using document root <none> and password file <none>
I20260809 19:00:33.634212 20244 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:33.634279 20244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:33.634431 20244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:33.635540 20244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "df6f536c99f9401c8ef7cf700a903bd6"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "9b8779431f033bb091ec4d78c21865d1"
server_key_iv: "98692592eb444e4ccbcb7fb59e47f3bf"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.635906 20244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "df6f536c99f9401c8ef7cf700a903bd6"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "9b8779431f033bb091ec4d78c21865d1"
server_key_iv: "98692592eb444e4ccbcb7fb59e47f3bf"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.637347 20244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:00:33.638054 20268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.638221 20244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 19:00:33.638325 20244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "df6f536c99f9401c8ef7cf700a903bd6"
format_stamp: "Formatted at 2026-08-09 19:00:33 on dist-test-slave-jq4t"
server_key: "9b8779431f033bb091ec4d78c21865d1"
server_key_iv: "98692592eb444e4ccbcb7fb59e47f3bf"
server_key_version: "encryptionkey@0"
I20260809 19:00:33.638398 20244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:33.655577 20244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:33.655925 20244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:33.656093 20244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:33.656347 20244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:33.656716 20244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:33.656771 20244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.656807 20244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:33.656852 20244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:33.662700 20244 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:38647
I20260809 19:00:33.662751 20427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:38647 every 8 connection(s)
I20260809 19:00:33.663103 20244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 19:00:33.663314 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 20244
I20260809 19:00:33.663445 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 19:00:33.663673 24468 external_mini_cluster.cc:1428] Setting key b1ad53693529119abbc66752e8324ffb
I20260809 19:00:33.668421 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.663895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:44277 (local address 127.23.229.62:38845)
0809 19:00:33.663994 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.663997 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.664277 (+ 280us) server_negotiation.cc:407] Connection header received
0809 19:00:33.664920 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.664921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.664932 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.664981 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:33.665653 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.666158 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.667113 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.667307 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.667356 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.668221 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:33.668222 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:33.668222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:33.668226 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:33.668236 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:33.668239 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:33.668276 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.668338 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.668360 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:00:33.668686 20433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.663873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:38845 (local address 127.23.229.3:44277)
0809 19:00:33.664099 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.664149 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.664833 (+ 684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.665040 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.665043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.665052 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:33.665585 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.665589 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.666239 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.666240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.667040 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.667042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.667384 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.667385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.667499 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.668090 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:33.668090 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:33.668120 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:33.668142 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:33.668278 (+ 136us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:33.668281 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:33.668283 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.668329 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.668412 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":104,"threads_started":1}
I20260809 19:00:33.669148 20430 heartbeater.cc:347] Connected to a master server at 127.23.229.62:38845
I20260809 19:00:33.669241 20430 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:33.669402 20430 heartbeater.cc:511] Master 127.23.229.62:38845 requested a full tablet report, sending...
I20260809 19:00:33.669770 19747 ts_manager.cc:194] Registered new tserver with Master: df6f536c99f9401c8ef7cf700a903bd6 (127.23.229.3:38647)
I20260809 19:00:33.670167 19747 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.3:44277
I20260809 19:00:33.675515 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:33.680189 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.676954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49790 (local address 127.23.229.62:38845)
0809 19:00:33.676995 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.676997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.677153 (+ 156us) server_negotiation.cc:407] Connection header received
0809 19:00:33.677230 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.677232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.677250 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.677311 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:33.677505 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.677992 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.678839 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.679043 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.679128 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.679911 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:33.679912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:33.679913 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:33.679918 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:33.679934 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:33.679937 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:33.680001 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.680064 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.680093 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 19:00:33.681782 19747 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:33.683346 19747 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:33.689692 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.685774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47418 (local address 127.23.229.3:38647)
0809 19:00:33.686125 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.686128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.686137 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:00:33.686171 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.686173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.686185 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.686275 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:33.686467 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.687276 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.688705 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.689300 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.689393 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.689498 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.689563 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.689600 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":101,"threads_started":1}
I20260809 19:00:33.689679 20442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.685575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:38647 (local address 127.0.0.1:47418)
0809 19:00:33.685889 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.685933 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.686000 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.686295 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.686298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.686301 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:33.686377 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.686379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.687374 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.687375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.688606 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.688609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.689385 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.689386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.689464 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.689477 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.689540 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.689598 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":105,"threads_started":1}
I20260809 19:00:33.690014 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.685579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:45105 (local address 127.0.0.1:36574)
0809 19:00:33.686106 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.686114 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.686157 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.686411 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.686412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.686415 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:33.686467 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.686469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.687799 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.687800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.688853 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.688855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.689798 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.689798 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.689853 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.689856 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.689902 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.689944 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":112,"threads_started":1}
I20260809 19:00:33.690022 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.685575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:44779 (local address 127.0.0.1:48450)
0809 19:00:33.686236 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.686245 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.686288 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.686585 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.686586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.686589 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:33.686627 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.686629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.687841 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.687842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.688744 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.688746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.689759 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.689760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.689824 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.689829 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.689881 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.689929 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":7,"thread_start_us":83,"threads_started":1}
I20260809 19:00:33.690229 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.685789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.23.229.2:44779)
0809 19:00:33.686033 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.686038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.686352 (+ 314us) server_negotiation.cc:407] Connection header received
0809 19:00:33.686401 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.686413 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.686429 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.686505 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:33.686707 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.687776 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.688826 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.689550 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.689625 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.689720 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.690068 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.690119 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":114,"threads_started":1}
I20260809 19:00:33.690368 20447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.685876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36574 (local address 127.23.229.1:45105)
0809 19:00:33.686071 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.686076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.686151 (+ 75us) server_negotiation.cc:407] Connection header received
0809 19:00:33.686225 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.686228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.686246 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.686326 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:33.686549 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.687705 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.688936 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.689631 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.689690 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.689767 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.690230 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.690282 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":112,"threads_started":1}
I20260809 19:00:33.690718 20333 tablet_service.cc:1467] Processing CreateTablet for tablet e81a0205d87142f58eb2088af6464217 (DEFAULT_TABLE table=test-table [id=ba5e5cc75a4c455fb2125b1ef1b3dfdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:33.691067 19943 tablet_service.cc:1467] Processing CreateTablet for tablet e81a0205d87142f58eb2088af6464217 (DEFAULT_TABLE table=test-table [id=ba5e5cc75a4c455fb2125b1ef1b3dfdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:33.691160 20333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e81a0205d87142f58eb2088af6464217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:33.691186 20138 tablet_service.cc:1467] Processing CreateTablet for tablet e81a0205d87142f58eb2088af6464217 (DEFAULT_TABLE table=test-table [id=ba5e5cc75a4c455fb2125b1ef1b3dfdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:33.691339 19943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e81a0205d87142f58eb2088af6464217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:33.691505 20138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e81a0205d87142f58eb2088af6464217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:33.694121 20448 tablet_bootstrap.cc:492] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: Bootstrap starting.
I20260809 19:00:33.694808 20448 tablet_bootstrap.cc:654] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:33.694826 20449 tablet_bootstrap.cc:492] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Bootstrap starting.
I20260809 19:00:33.694818 20450 tablet_bootstrap.cc:492] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Bootstrap starting.
I20260809 19:00:33.695145 20448 log.cc:824] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:33.695475 20449 tablet_bootstrap.cc:654] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:33.695475 20450 tablet_bootstrap.cc:654] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:33.695806 20450 log.cc:824] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:33.695806 20449 log.cc:824] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:33.695859 20448 tablet_bootstrap.cc:492] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: No bootstrap required, opened a new log
I20260809 19:00:33.695940 20448 ts_tablet_manager.cc:1397] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:00:33.696635 20449 tablet_bootstrap.cc:492] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: No bootstrap required, opened a new log
I20260809 19:00:33.696722 20449 ts_tablet_manager.cc:1397] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:33.696854 20450 tablet_bootstrap.cc:492] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: No bootstrap required, opened a new log
I20260809 19:00:33.696943 20450 ts_tablet_manager.cc:1397] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:00:33.698676 20450 raft_consensus.cc:348] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.698633 20448 raft_consensus.cc:348] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.698820 20448 raft_consensus.cc:374] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:33.698820 20450 raft_consensus.cc:374] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:33.698868 20450 raft_consensus.cc:729] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2786f43698c84d48b43250ee8b2c91c8, State: Initialized, Role: FOLLOWER
I20260809 19:00:33.698869 20448 raft_consensus.cc:729] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f17ccfc7461141f0b99d310d401b450e, State: Initialized, Role: FOLLOWER
I20260809 19:00:33.698984 20450 consensus_queue.cc:260] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.699007 20448 consensus_queue.cc:260] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.699265 20448 ts_tablet_manager.cc:1428] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260809 19:00:33.699268 20450 ts_tablet_manager.cc:1428] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 19:00:33.699298 20241 heartbeater.cc:503] Master 127.23.229.62:38845 was elected leader, sending a full tablet report...
I20260809 19:00:33.699301 20449 raft_consensus.cc:348] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.699433 20037 heartbeater.cc:503] Master 127.23.229.62:38845 was elected leader, sending a full tablet report...
I20260809 19:00:33.699433 20449 raft_consensus.cc:374] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:33.699510 20449 raft_consensus.cc:729] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6f536c99f9401c8ef7cf700a903bd6, State: Initialized, Role: FOLLOWER
I20260809 19:00:33.699615 20449 consensus_queue.cc:260] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.699873 20449 ts_tablet_manager.cc:1428] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 19:00:33.699929 20430 heartbeater.cc:503] Master 127.23.229.62:38845 was elected leader, sending a full tablet report...
W20260809 19:00:33.777637 20242 tablet.cc:2369] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:00:33.897785 20038 tablet.cc:2369] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:33.911594 20458 raft_consensus.cc:482] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:33.911732 20458 raft_consensus.cc:504] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.912206 20458 leader_election.cc:288] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2786f43698c84d48b43250ee8b2c91c8 (127.23.229.2:44779), f17ccfc7461141f0b99d310d401b450e (127.23.229.1:45105)
W20260809 19:00:33.913805 20431 tablet.cc:2369] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:33.915452 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.912535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:56451 (local address 127.23.229.2:44779)
0809 19:00:33.912606 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.912609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.912626 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:00:33.912664 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.912665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.912680 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.912754 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:33.912943 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.913467 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.914567 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.915110 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.915182 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.915191 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.915340 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.915377 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 19:00:33.915452 20433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.912424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:44779 (local address 127.23.229.3:56451)
0809 19:00:33.912531 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.912545 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.912597 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.912761 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.912762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.912764 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:33.912847 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.912848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.913558 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.913559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.914475 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.914477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.915179 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.915180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.915251 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.915255 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.915333 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.915377 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":27}
I20260809 19:00:33.915580 20460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.912433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:45105 (local address 127.23.229.3:39567)
0809 19:00:33.912758 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:33.912766 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:33.912829 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:33.913004 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:33.913005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:33.913006 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:33.913077 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.913079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.913710 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.913711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.914547 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:33.914549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.915258 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.915259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:33.915333 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.915336 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:33.915397 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 19:00:33.915436 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":135,"thread_start_us":134,"threads_started":1}
I20260809 19:00:33.915802 20173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81a0205d87142f58eb2088af6464217" candidate_uuid: "df6f536c99f9401c8ef7cf700a903bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2786f43698c84d48b43250ee8b2c91c8" is_pre_election: true
I20260809 19:00:33.915855 20447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.912569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:39567 (local address 127.23.229.1:45105)
0809 19:00:33.912639 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.912641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.912827 (+ 186us) server_negotiation.cc:407] Connection header received
0809 19:00:33.912888 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.912889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.912902 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.912987 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:33.913148 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.913617 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.914638 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.915173 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.915248 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.915257 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.915403 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.915441 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 19:00:33.915977 20173 raft_consensus.cc:2454] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df6f536c99f9401c8ef7cf700a903bd6 in term 0.
I20260809 19:00:33.916141 19974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81a0205d87142f58eb2088af6464217" candidate_uuid: "df6f536c99f9401c8ef7cf700a903bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f17ccfc7461141f0b99d310d401b450e" is_pre_election: true
I20260809 19:00:33.916224 20270 leader_election.cc:302] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2786f43698c84d48b43250ee8b2c91c8, df6f536c99f9401c8ef7cf700a903bd6; no voters:
I20260809 19:00:33.916301 19974 raft_consensus.cc:2454] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df6f536c99f9401c8ef7cf700a903bd6 in term 0.
I20260809 19:00:33.916376 20458 raft_consensus.cc:2781] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:33.916451 20458 raft_consensus.cc:482] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:33.916505 20458 raft_consensus.cc:3037] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:33.917263 20458 raft_consensus.cc:504] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.917419 20458 leader_election.cc:288] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [CANDIDATE]: Term 1 election: Requested vote from peers 2786f43698c84d48b43250ee8b2c91c8 (127.23.229.2:44779), f17ccfc7461141f0b99d310d401b450e (127.23.229.1:45105)
I20260809 19:00:33.917580 20173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81a0205d87142f58eb2088af6464217" candidate_uuid: "df6f536c99f9401c8ef7cf700a903bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2786f43698c84d48b43250ee8b2c91c8"
I20260809 19:00:33.917596 19974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81a0205d87142f58eb2088af6464217" candidate_uuid: "df6f536c99f9401c8ef7cf700a903bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f17ccfc7461141f0b99d310d401b450e"
I20260809 19:00:33.917661 20173 raft_consensus.cc:3037] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:33.917667 19974 raft_consensus.cc:3037] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:33.918577 19974 raft_consensus.cc:2454] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6f536c99f9401c8ef7cf700a903bd6 in term 1.
I20260809 19:00:33.918577 20173 raft_consensus.cc:2454] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6f536c99f9401c8ef7cf700a903bd6 in term 1.
I20260809 19:00:33.918777 20269 leader_election.cc:302] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df6f536c99f9401c8ef7cf700a903bd6, f17ccfc7461141f0b99d310d401b450e; no voters:
I20260809 19:00:33.918879 20458 raft_consensus.cc:2781] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:33.919016 20458 raft_consensus.cc:686] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 1 LEADER]: Becoming Leader. State: Replica: df6f536c99f9401c8ef7cf700a903bd6, State: Running, Role: LEADER
I20260809 19:00:33.919119 20458 consensus_queue.cc:237] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } }
I20260809 19:00:33.919905 19747 catalog_manager.cc:5495] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to df6f536c99f9401c8ef7cf700a903bd6 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "df6f536c99f9401c8ef7cf700a903bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6f536c99f9401c8ef7cf700a903bd6" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 38647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 } health_report { overall_health: UNKNOWN } } }
I20260809 19:00:33.975908 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:33.973421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47432 (local address 127.23.229.3:38647)
0809 19:00:33.973490 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:33.973492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:33.973500 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:00:33.973547 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:33.973548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:33.973567 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:33.973648 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:33.973800 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.974296 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.975089 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:33.975297 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:33.975374 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:33.975549 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:33.975655 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:33.975746 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:33.975765 (+ 19us) server_negotiation.cc:299] Negotiation successful
0809 19:00:33.975783 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 19:00:33.977919 19974 raft_consensus.cc:1261] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 1 FOLLOWER]: Refusing update from remote peer df6f536c99f9401c8ef7cf700a903bd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:33.977919 20173 raft_consensus.cc:1261] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 1 FOLLOWER]: Refusing update from remote peer df6f536c99f9401c8ef7cf700a903bd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:33.978305 20458 consensus_queue.cc:1035] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f17ccfc7461141f0b99d310d401b450e" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 45105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:33.978457 20461 consensus_queue.cc:1035] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2786f43698c84d48b43250ee8b2c91c8" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:33.981242 20470 mvcc.cc:205] Tried to move back new op lower bound from 7316693131170533376 to 7316693130933309440. Current Snapshot: MvccSnapshot[applied={T|T < 7316693131170533376}]
I20260809 19:00:33.981284 20468 mvcc.cc:205] Tried to move back new op lower bound from 7316693131170533376 to 7316693130933309440. Current Snapshot: MvccSnapshot[applied={T|T < 7316693131170533376}]
I20260809 19:00:33.983964 19747 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:33.984082 19747 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:33.984949 19747 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1473a4dcf6d0426fa582830b3491e3e1: Sending DeleteTablet for 3 replicas of tablet e81a0205d87142f58eb2088af6464217
I20260809 19:00:33.985299 20138 tablet_service.cc:1514] Processing DeleteTablet for tablet e81a0205d87142f58eb2088af6464217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:33 UTC) from {username='slave'} at 127.0.0.1:48450
I20260809 19:00:33.985394 19943 tablet_service.cc:1514] Processing DeleteTablet for tablet e81a0205d87142f58eb2088af6464217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:33 UTC) from {username='slave'} at 127.0.0.1:36574
I20260809 19:00:33.985442 20333 tablet_service.cc:1514] Processing DeleteTablet for tablet e81a0205d87142f58eb2088af6464217 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:33 UTC) from {username='slave'} at 127.0.0.1:47418
I20260809 19:00:33.985646 20482 tablet_replica.cc:330] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e: stopping tablet replica
I20260809 19:00:33.985677 20481 tablet_replica.cc:330] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: stopping tablet replica
I20260809 19:00:33.985762 20481 raft_consensus.cc:2229] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:33.985756 20482 raft_consensus.cc:2229] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:33.985814 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 19842
I20260809 19:00:33.985878 20481 raft_consensus.cc:2258] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:33.985877 20482 raft_consensus.cc:2258] T e81a0205d87142f58eb2088af6464217 P f17ccfc7461141f0b99d310d401b450e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:33.988945 20483 tablet_replica.cc:330] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: stopping tablet replica
I20260809 19:00:33.989063 20483 raft_consensus.cc:2229] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:33.989212 20483 raft_consensus.cc:2258] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:33.991218 20483 ts_tablet_manager.cc:1905] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:33.993194 20483 ts_tablet_manager.cc:1918] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:33.993273 20483 log.cc:1196] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/e81a0205d87142f58eb2088af6464217
I20260809 19:00:33.993512 20483 ts_tablet_manager.cc:1939] T e81a0205d87142f58eb2088af6464217 P df6f536c99f9401c8ef7cf700a903bd6: Deleting consensus metadata
I20260809 19:00:33.994362 19728 catalog_manager.cc:4841] TS df6f536c99f9401c8ef7cf700a903bd6 (127.23.229.3:38647): tablet e81a0205d87142f58eb2088af6464217 (table test-table [id=ba5e5cc75a4c455fb2125b1ef1b3dfdc]) successfully deleted
I20260809 19:00:33.997773 20481 ts_tablet_manager.cc:1905] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:33.999815 20481 ts_tablet_manager.cc:1918] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:33.999920 20481 log.cc:1196] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/e81a0205d87142f58eb2088af6464217
I20260809 19:00:34.000198 20481 ts_tablet_manager.cc:1939] T e81a0205d87142f58eb2088af6464217 P 2786f43698c84d48b43250ee8b2c91c8: Deleting consensus metadata
I20260809 19:00:34.000741 19726 catalog_manager.cc:4841] TS 2786f43698c84d48b43250ee8b2c91c8 (127.23.229.2:44779): tablet e81a0205d87142f58eb2088af6464217 (table test-table [id=ba5e5cc75a4c455fb2125b1ef1b3dfdc]) successfully deleted
W20260809 19:00:34.002772 19725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:45105 (error 108)
I20260809 19:00:34.003321 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:34.003171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:45105 (local address 127.0.0.1:36576)
0809 19:00:34.003234 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:34.003285 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:45105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 19:00:34.003407 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 20041
W20260809 19:00:34.003499 19725 catalog_manager.cc:4584] TS f17ccfc7461141f0b99d310d401b450e (127.23.229.1:45105): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e81a0205d87142f58eb2088af6464217: Network error: Client connection negotiation failed: client connection to 127.23.229.1:45105: connect: Connection refused (error 111)
I20260809 19:00:34.014520 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 20244
I20260809 19:00:34.028432 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 19704
2026-08-09T19:00:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (947 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:34 dist-test-slave-jq4t krb5kdc[20490](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:34 dist-test-slave-jq4t krb5kdc[20490](info): set up 2 sockets
Aug 09 19:00:34 dist-test-slave-jq4t krb5kdc[20490](info): commencing operation
krb5kdc: starting...
W20260809 19:00:35.274554 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:35 dist-test-slave-jq4t krb5kdc[20490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:00:35.401192 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:46209
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:46209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:35.486086 20508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:35.486334 20508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:35.486374 20508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:35.487524 20508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:35.487567 20508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:35.487581 20508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:35.487593 20508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:35.487605 20508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:35.489120 20508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:46209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:46209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:35.489336 20508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:35.489521 20508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:35.494760 20515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:35.494727 20519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:35.494773 20508 server_base.cc:1034] running on GCE node
W20260809 19:00:35.494740 20514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:35.495245 20508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:35.495551 20508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:35.496693 20508 hybrid_clock.cc:648] HybridClock initialized: now 1786302035496675 us; error 40 us; skew 500 ppm
Aug 09 19:00:35 dist-test-slave-jq4t krb5kdc[20490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302035, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:35.499262 20508 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:00:35.499670 20508 webserver.cc:460] Webserver started at http://127.23.229.62:45873/ using document root <none> and password file <none>
I20260809 19:00:35.499881 20508 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:35.499923 20508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:35.500020 20508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:35.501097 20508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "eae70827e8d6499d860b19409ba2f12d"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "145bcb092800b1a3b8d4fc355786e15f"
server_key_iv: "de8916bdb4be71bd87e15e34a7a3677c"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.501403 20508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "eae70827e8d6499d860b19409ba2f12d"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "145bcb092800b1a3b8d4fc355786e15f"
server_key_iv: "de8916bdb4be71bd87e15e34a7a3677c"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.502698 20508 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 19:00:35.503439 20529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.503640 20508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:35.503747 20508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "eae70827e8d6499d860b19409ba2f12d"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "145bcb092800b1a3b8d4fc355786e15f"
server_key_iv: "de8916bdb4be71bd87e15e34a7a3677c"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.503830 20508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:35.516570 20508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:35.519032 20508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:35.519200 20508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:35.523561 20508 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:46209
I20260809 19:00:35.523602 20609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:46209 every 8 connection(s)
I20260809 19:00:35.523980 20508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:35.525041 20611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:35.527159 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 20508
I20260809 19:00:35.527284 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:35.527493 24468 external_mini_cluster.cc:1428] Setting key 3e71e123022a9b8992fed61f7daccb75
I20260809 19:00:35.527768 20611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d: Bootstrap starting.
I20260809 19:00:35.528596 20611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:35.528911 20611 log.cc:824] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:35.529767 20611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d: No bootstrap required, opened a new log
I20260809 19:00:35.532014 20611 raft_consensus.cc:348] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae70827e8d6499d860b19409ba2f12d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46209 } }
I20260809 19:00:35.532192 20611 raft_consensus.cc:374] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:35.532244 20611 raft_consensus.cc:729] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae70827e8d6499d860b19409ba2f12d, State: Initialized, Role: FOLLOWER
I20260809 19:00:35.532415 20611 consensus_queue.cc:260] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae70827e8d6499d860b19409ba2f12d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46209 } }
I20260809 19:00:35.532522 20611 raft_consensus.cc:388] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:35.532565 20611 raft_consensus.cc:482] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:35.532634 20611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:35.533443 20611 raft_consensus.cc:504] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae70827e8d6499d860b19409ba2f12d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46209 } }
I20260809 19:00:35.533572 20611 leader_election.cc:302] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eae70827e8d6499d860b19409ba2f12d; no voters:
I20260809 19:00:35.533766 20611 leader_election.cc:288] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:35.533803 20618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:35.534024 20618 raft_consensus.cc:686] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [term 1 LEADER]: Becoming Leader. State: Replica: eae70827e8d6499d860b19409ba2f12d, State: Running, Role: LEADER
I20260809 19:00:35.534127 20618 consensus_queue.cc:237] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae70827e8d6499d860b19409ba2f12d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46209 } }
I20260809 19:00:35.534149 20611 sys_catalog.cc:564] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:35.534449 20618 sys_catalog.cc:455] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [sys.catalog]: SysCatalogTable state changed. Reason: New leader eae70827e8d6499d860b19409ba2f12d. Latest consensus state: current_term: 1 leader_uuid: "eae70827e8d6499d860b19409ba2f12d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae70827e8d6499d860b19409ba2f12d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46209 } } }
I20260809 19:00:35.534541 20618 sys_catalog.cc:458] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:35.534459 20622 sys_catalog.cc:455] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eae70827e8d6499d860b19409ba2f12d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae70827e8d6499d860b19409ba2f12d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 46209 } } }
I20260809 19:00:35.534698 20622 sys_catalog.cc:458] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d [sys.catalog]: This master's current role is: LEADER
Aug 09 19:00:35 dist-test-slave-jq4t krb5kdc[20490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
W20260809 19:00:35.536584 20642 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:00:35.536650 20642 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:00:35.536733 20625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:35.536947 20625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:35.538667 20625 catalog_manager.cc:1347] Generated new cluster ID: f277edf544d940dd96c069d995b7238c
I20260809 19:00:35.538723 20625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:35.539814 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:35.528082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.23.229.62:46209)
0809 19:00:35.528275 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:35.528283 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:35.528318 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:00:35.528875 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:35.528883 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:35.528937 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:35.529089 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:35.529904 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.530846 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.532049 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.532728 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.532833 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:35.535924 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:35.535930 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:35.535931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:35.535943 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:35.538074 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:35.538511 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:35.538514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:35.538515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:35.538631 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:35.538853 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:35.538854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:35.538854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:35.539157 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:35.539286 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:35.539458 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 19:00:35.539592 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260809 19:00:35.560546 20625 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:35.561337 20625 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:35.564882 20625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d: Generated new TSK 0
I20260809 19:00:35.565116 20625 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 19:00:35.599287 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46209
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:35.683797 20655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:35.684037 20655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:35.684075 20655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:35.685252 20655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:35.685312 20655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:35.685365 20655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 19:00:35.686834 20655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:35.687111 20655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:35.687356 20655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:35.692643 20664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:35.692667 20655 server_base.cc:1034] running on GCE node
W20260809 19:00:35.692667 20660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:35.692770 20661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:35.693065 20655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:35.693328 20655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:35.694492 20655 hybrid_clock.cc:648] HybridClock initialized: now 1786302035694481 us; error 42 us; skew 500 ppm
Aug 09 19:00:35 dist-test-slave-jq4t krb5kdc[20490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302035, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:35.697134 20655 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 19:00:35.697540 20655 webserver.cc:460] Webserver started at http://127.23.229.1:46289/ using document root <none> and password file <none>
I20260809 19:00:35.697729 20655 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:35.697770 20655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:35.697872 20655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:35.698875 20655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "2845400e238c051268bdea27e8c00f5d"
server_key_iv: "954477780e1bfe4e807753e2897421a2"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.699213 20655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "2845400e238c051268bdea27e8c00f5d"
server_key_iv: "954477780e1bfe4e807753e2897421a2"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.700592 20655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 19:00:35.701400 20675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.701601 20655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:35.701697 20655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "2845400e238c051268bdea27e8c00f5d"
server_key_iv: "954477780e1bfe4e807753e2897421a2"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.701756 20655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:35.709784 20655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:35.712035 20655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:35.712150 20655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:35.712329 20655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:35.712654 20655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:35.712692 20655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.712713 20655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:35.712725 20655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.718676 20655 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:42935
I20260809 19:00:35.718755 20831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:42935 every 8 connection(s)
I20260809 19:00:35.719090 20655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:35.725126 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 20655
Aug 09 19:00:35 dist-test-slave-jq4t krb5kdc[20490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302035, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:35.725216 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 19:00:35.725405 24468 external_mini_cluster.cc:1428] Setting key 026f6a2409a62f384297c00dc2ea2577
I20260809 19:00:35.728466 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:35.719887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:46099 (local address 127.23.229.62:46209)
0809 19:00:35.719954 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:35.719956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:35.720119 (+ 163us) server_negotiation.cc:407] Connection header received
0809 19:00:35.720693 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:35.720694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:35.720703 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:35.720766 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:35.721716 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.722232 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.723195 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.723424 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.723475 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:35.725703 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:35.725704 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:35.725704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:35.725712 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:35.727071 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:35.727470 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:35.727471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:35.727472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:35.727532 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:35.727782 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:35.727783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:35.727783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:35.727902 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:35.727995 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:35.728275 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 19:00:35.728377 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 19:00:35.728709 20834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:35.719823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:46209 (local address 127.23.229.1:46099)
0809 19:00:35.719989 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:35.720034 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:35.720605 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:35.720842 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:35.720846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:35.721427 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:35.721639 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:35.721643 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.722313 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.722313 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:35.723120 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:35.723122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.723500 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.723501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:35.723602 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:35.724145 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:35.724154 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:35.725611 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:35.727155 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:35.727164 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:35.727166 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:35.727394 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:35.727599 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:35.727600 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:35.727601 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:35.727716 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:35.727986 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:35.727994 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:35.728147 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 19:00:35.728253 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 19:00:35.728414 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260809 19:00:35.729158 20832 heartbeater.cc:347] Connected to a master server at 127.23.229.62:46209
I20260809 19:00:35.729266 20832 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:35.729460 20832 heartbeater.cc:511] Master 127.23.229.62:46209 requested a full tablet report, sending...
I20260809 19:00:35.729997 20555 ts_manager.cc:194] Registered new tserver with Master: be9dcbf8e4b64ed192c57f1b5e11bc77 (127.23.229.1:42935)
I20260809 19:00:35.730608 20555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:46099
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 19:00:35.752739 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46209
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:35.840539 20839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:35.840760 20839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:35.840786 20839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:35.841923 20839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:35.841959 20839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:35.841985 20839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 19:00:35.843432 20839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:35.843637 20839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:35.843834 20839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:35.849217 20846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:35.849267 20845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:35.849203 20849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:35.849458 20839 server_base.cc:1034] running on GCE node
I20260809 19:00:35.849663 20839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:35.849900 20839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:35.851074 20839 hybrid_clock.cc:648] HybridClock initialized: now 1786302035851062 us; error 26 us; skew 500 ppm
Aug 09 19:00:35 dist-test-slave-jq4t krb5kdc[20490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302035, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:35.853685 20839 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 19:00:35.854121 20839 webserver.cc:460] Webserver started at http://127.23.229.2:42315/ using document root <none> and password file <none>
I20260809 19:00:35.854377 20839 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:35.854449 20839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:35.854596 20839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:35.855669 20839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "d8c8d2793b3844dfb1585a17309d0f96"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "eb1af7353480e75b08f35714e24a5df0"
server_key_iv: "491c7f66ef2cd125c462e2b4e2c8ebc2"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.856042 20839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "d8c8d2793b3844dfb1585a17309d0f96"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "eb1af7353480e75b08f35714e24a5df0"
server_key_iv: "491c7f66ef2cd125c462e2b4e2c8ebc2"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.857574 20839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:00:35.858314 20858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.858477 20839 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.858568 20839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "d8c8d2793b3844dfb1585a17309d0f96"
format_stamp: "Formatted at 2026-08-09 19:00:35 on dist-test-slave-jq4t"
server_key: "eb1af7353480e75b08f35714e24a5df0"
server_key_iv: "491c7f66ef2cd125c462e2b4e2c8ebc2"
server_key_version: "encryptionkey@0"
I20260809 19:00:35.858649 20839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:35.872427 20839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:35.874368 20839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:35.874549 20839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:35.874805 20839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:35.875135 20839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:35.875190 20839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.875226 20839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:35.875268 20839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:35.881366 20839 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:41219
I20260809 19:00:35.881448 21024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:41219 every 8 connection(s)
I20260809 19:00:35.881781 20839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 19:00:35 dist-test-slave-jq4t krb5kdc[20490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302035, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:35.888645 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 20839
I20260809 19:00:35.888764 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 19:00:35.889027 24468 external_mini_cluster.cc:1428] Setting key c130dd1f1eaacd7122d97d3ec86077da
I20260809 19:00:35.891463 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:35.882548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:47747 (local address 127.23.229.62:46209)
0809 19:00:35.882595 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:35.882597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:35.882803 (+ 206us) server_negotiation.cc:407] Connection header received
0809 19:00:35.883312 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:35.883313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:35.883323 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:35.883384 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:35.884344 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.884872 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.885843 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.886030 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.886082 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:35.888328 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:35.888330 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:35.888330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:35.888337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:35.889985 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:35.890473 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:35.890474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:35.890474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:35.890526 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:35.890821 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:35.890822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:35.890822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:35.890927 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:35.890979 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:35.891318 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 19:00:35.891390 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 19:00:35.891793 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:35.882508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:46209 (local address 127.23.229.2:47747)
0809 19:00:35.882680 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:35.882724 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:35.883226 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:35.883466 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:35.883470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:35.884064 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:35.884266 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:35.884271 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.884945 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.884946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:35.885771 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:35.885773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:35.886103 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:35.886103 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:35.886210 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:35.886796 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:35.886805 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:35.888237 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:35.890063 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:35.890071 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:35.890073 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:35.890400 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:35.890591 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:35.890592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:35.890592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:35.890751 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:35.890987 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:35.890995 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:35.891173 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 19:00:35.891291 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 19:00:35.891482 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
I20260809 19:00:35.892319 21025 heartbeater.cc:347] Connected to a master server at 127.23.229.62:46209
I20260809 19:00:35.892434 21025 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:35.892654 21025 heartbeater.cc:511] Master 127.23.229.62:46209 requested a full tablet report, sending...
I20260809 19:00:35.893106 20555 ts_manager.cc:194] Registered new tserver with Master: d8c8d2793b3844dfb1585a17309d0f96 (127.23.229.2:41219)
I20260809 19:00:35.893494 20555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:47747
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 19:00:35.915024 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46209
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:36.000124 21033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:36.000406 21033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:36.000447 21033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:36.001663 21033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:36.001745 21033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:36.001788 21033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 19:00:36.003369 21033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:46209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:36.003698 21033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:36.003962 21033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:36.009495 21045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.009487 21041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.009480 21042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:36.009770 21033 server_base.cc:1034] running on GCE node
I20260809 19:00:36.009997 21033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:36.010310 21033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:36.011497 21033 hybrid_clock.cc:648] HybridClock initialized: now 1786302036011476 us; error 38 us; skew 500 ppm
Aug 09 19:00:36 dist-test-slave-jq4t krb5kdc[20490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302036, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:36.014333 21033 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 19:00:36.014848 21033 webserver.cc:460] Webserver started at http://127.23.229.3:34067/ using document root <none> and password file <none>
I20260809 19:00:36.015111 21033 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:36.015177 21033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:36.015324 21033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:36.016418 21033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "892c524ed2f14ce7b7ef17962125f5b8"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "13accbf056b07ac4b6529227e0648787"
server_key_iv: "e8e1fbcea17e27d0588894627fa9fbf6"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.016855 21033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "892c524ed2f14ce7b7ef17962125f5b8"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "13accbf056b07ac4b6529227e0648787"
server_key_iv: "e8e1fbcea17e27d0588894627fa9fbf6"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.018220 21033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:36.019062 21054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.019287 21033 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:36.019409 21033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "892c524ed2f14ce7b7ef17962125f5b8"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "13accbf056b07ac4b6529227e0648787"
server_key_iv: "e8e1fbcea17e27d0588894627fa9fbf6"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.019491 21033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:36.054057 21033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:36.056583 21033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:36.056746 21033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:36.057004 21033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:36.057353 21033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:36.057405 21033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.057446 21033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:36.057472 21033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.063683 21033 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:37691
I20260809 19:00:36.063730 21216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:37691 every 8 connection(s)
I20260809 19:00:36.064069 21033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 19:00:36 dist-test-slave-jq4t krb5kdc[20490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302036, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:36.071139 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 21033
I20260809 19:00:36.071259 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 19:00:36.071493 24468 external_mini_cluster.cc:1428] Setting key 3986e1da7c9a50ee9c78b80dca4eadad
I20260809 19:00:36.074123 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.064797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:42611 (local address 127.23.229.62:46209)
0809 19:00:36.064842 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.064844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.065100 (+ 256us) server_negotiation.cc:407] Connection header received
0809 19:00:36.065655 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.065657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.065671 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.065739 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:36.066715 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.067235 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.068275 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.068552 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.068641 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.070825 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:36.070827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:36.070827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:36.070836 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:36.072721 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:36.073133 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:36.073134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:36.073134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:36.073195 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:36.073450 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:36.073451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:36.073452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:36.073578 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:36.073656 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.073935 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.074029 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 19:00:36.074358 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.064753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:46209 (local address 127.23.229.3:42611)
0809 19:00:36.064976 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.065014 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.065551 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.065816 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.065819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.066418 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:36.066613 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.066617 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.067339 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.067341 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.068182 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.068184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.068651 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.068653 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.068781 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.069301 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:36.069310 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:36.070714 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:36.072805 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:36.072813 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:36.072815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:36.073055 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:36.073276 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:36.073276 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:36.073277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:36.073384 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:36.073646 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:36.073653 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:36.073798 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.073900 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.074078 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":112,"threads_started":1}
I20260809 19:00:36.074870 21217 heartbeater.cc:347] Connected to a master server at 127.23.229.62:46209
I20260809 19:00:36.074965 21217 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:36.075171 21217 heartbeater.cc:511] Master 127.23.229.62:46209 requested a full tablet report, sending...
I20260809 19:00:36.075565 20555 ts_manager.cc:194] Registered new tserver with Master: 892c524ed2f14ce7b7ef17962125f5b8 (127.23.229.3:37691)
I20260809 19:00:36.075984 20555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:42611
I20260809 19:00:36.083575 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:36.091575 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.085070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48934 (local address 127.23.229.62:46209)
0809 19:00:36.085134 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.085136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.085238 (+ 102us) server_negotiation.cc:407] Connection header received
0809 19:00:36.085283 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.085284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.085293 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.085349 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:36.085910 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.086424 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.087146 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.087341 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.087400 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.088785 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:36.088786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:36.088787 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:36.088794 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:36.090286 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:36.090708 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:36.090710 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:36.090710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:36.090780 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:36.091015 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:36.091016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:36.091016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:36.091159 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:36.091247 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.091450 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.091506 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 19:00:36.093267 20555 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:36.094897 20555 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:36.101665 21236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.097320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:41219 (local address 127.0.0.1:59038)
0809 19:00:36.097559 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.097570 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.097616 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.098041 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.098044 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.098047 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.098120 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.098122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.099142 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.099143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.100334 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.100337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.101306 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.101307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.101401 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.101418 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.101472 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.101538 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":3,"thread_start_us":109,"threads_started":1}
I20260809 19:00:36.101675 21244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.097720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51484 (local address 127.23.229.3:37691)
0809 19:00:36.097896 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.097901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.097909 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:00:36.097941 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.097943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.097955 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.098288 (+ 333us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.098478 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.099525 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.100696 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.101224 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.101318 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.101386 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.101546 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.101589 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
I20260809 19:00:36.101791 21235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.097306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42935 (local address 127.0.0.1:36846)
0809 19:00:36.097502 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.097698 (+ 196us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.097734 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.098155 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.098156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.098158 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.098210 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.098212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.099571 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.099572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.100683 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.100687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.101598 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.101599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.101655 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.101658 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.101688 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.101727 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":5,"thread_start_us":85,"threads_started":1}
I20260809 19:00:36.101861 21243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.097605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59038 (local address 127.23.229.2:41219)
0809 19:00:36.097827 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.097832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.097845 (+ 13us) server_negotiation.cc:407] Connection header received
0809 19:00:36.097891 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.097894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.097911 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.098010 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.098233 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.099036 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.100413 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.101198 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.101628 (+ 430us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.101702 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.101727 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.101770 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":89,"threads_started":1}
I20260809 19:00:36.102296 21238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.097519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36846 (local address 127.23.229.1:42935)
0809 19:00:36.097953 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.097957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.097966 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:00:36.098008 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.098010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.098025 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.098131 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.098300 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.099453 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.100753 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.101503 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.102061 (+ 558us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.102138 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.102163 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.102208 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":95,"threads_started":1}
I20260809 19:00:36.102380 21234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.097306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:37691 (local address 127.0.0.1:51484)
0809 19:00:36.097498 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.097539 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.097616 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.098370 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.098372 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.098374 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.098409 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.098410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.099607 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.099609 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.100611 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.100614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.101317 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.101318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.101416 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.101421 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.101526 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.101575 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":1,"thread_start_us":68,"threads_started":1}
I20260809 19:00:36.102779 20922 tablet_service.cc:1467] Processing CreateTablet for tablet ed4e2f05024e4da280a764a093a8419f (DEFAULT_TABLE table=test-table [id=cb6eba69eff6441f8f0d461dd81009f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:36.103013 20738 tablet_service.cc:1467] Processing CreateTablet for tablet ed4e2f05024e4da280a764a093a8419f (DEFAULT_TABLE table=test-table [id=cb6eba69eff6441f8f0d461dd81009f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:36.103233 20922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4e2f05024e4da280a764a093a8419f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:36.103353 20738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4e2f05024e4da280a764a093a8419f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:36.105165 21119 tablet_service.cc:1467] Processing CreateTablet for tablet ed4e2f05024e4da280a764a093a8419f (DEFAULT_TABLE table=test-table [id=cb6eba69eff6441f8f0d461dd81009f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:36.105494 21119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4e2f05024e4da280a764a093a8419f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:36.107040 21245 tablet_bootstrap.cc:492] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Bootstrap starting.
I20260809 19:00:36.107776 21247 tablet_bootstrap.cc:492] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77: Bootstrap starting.
I20260809 19:00:36.108438 21247 tablet_bootstrap.cc:654] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:36.108671 21248 tablet_bootstrap.cc:492] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Bootstrap starting.
I20260809 19:00:36.109125 21247 log.cc:824] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:36.109462 21245 tablet_bootstrap.cc:654] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:36.109462 21248 tablet_bootstrap.cc:654] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:36.109949 21245 log.cc:824] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:36.109978 21247 tablet_bootstrap.cc:492] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77: No bootstrap required, opened a new log
I20260809 19:00:36.110069 21247 ts_tablet_manager.cc:1397] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 19:00:36.110071 21248 log.cc:824] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:36.110812 21245 tablet_bootstrap.cc:492] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: No bootstrap required, opened a new log
I20260809 19:00:36.110891 21245 ts_tablet_manager.cc:1397] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 19:00:36.112090 21247 raft_consensus.cc:348] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.112285 21247 raft_consensus.cc:374] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:36.112325 21247 raft_consensus.cc:729] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be9dcbf8e4b64ed192c57f1b5e11bc77, State: Initialized, Role: FOLLOWER
I20260809 19:00:36.112468 21247 consensus_queue.cc:260] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.112964 20832 heartbeater.cc:503] Master 127.23.229.62:46209 was elected leader, sending a full tablet report...
I20260809 19:00:36.112931 21245 raft_consensus.cc:348] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.113058 21248 tablet_bootstrap.cc:492] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: No bootstrap required, opened a new log
I20260809 19:00:36.113102 21245 raft_consensus.cc:374] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:36.113127 21248 ts_tablet_manager.cc:1397] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 19:00:36.113152 21245 raft_consensus.cc:729] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c8d2793b3844dfb1585a17309d0f96, State: Initialized, Role: FOLLOWER
I20260809 19:00:36.113276 21245 consensus_queue.cc:260] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.113365 21247 ts_tablet_manager.cc:1428] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 19:00:36.113572 21025 heartbeater.cc:503] Master 127.23.229.62:46209 was elected leader, sending a full tablet report...
I20260809 19:00:36.113582 21245 ts_tablet_manager.cc:1428] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 19:00:36.114856 21248 raft_consensus.cc:348] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.115016 21248 raft_consensus.cc:374] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:36.115065 21248 raft_consensus.cc:729] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c524ed2f14ce7b7ef17962125f5b8, State: Initialized, Role: FOLLOWER
I20260809 19:00:36.115180 21248 consensus_queue.cc:260] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.115429 21248 ts_tablet_manager.cc:1428] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 19:00:36.115463 21217 heartbeater.cc:503] Master 127.23.229.62:46209 was elected leader, sending a full tablet report...
W20260809 19:00:36.132372 21026 tablet.cc:2369] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:00:36.219856 20833 tablet.cc:2369] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:36.235008 21258 raft_consensus.cc:482] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:36.235148 21258 raft_consensus.cc:504] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.235591 21258 leader_election.cc:288] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be9dcbf8e4b64ed192c57f1b5e11bc77 (127.23.229.1:42935), d8c8d2793b3844dfb1585a17309d0f96 (127.23.229.2:41219)
I20260809 19:00:36.238596 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.235786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42935 (local address 127.23.229.3:46927)
0809 19:00:36.235864 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.235875 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.235941 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.236149 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.236150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.236152 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.236241 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.236243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.236972 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.236973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.237752 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.237755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.238312 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.238313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.238402 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.238415 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.238466 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.238507 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 19:00:36.238610 21238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.235940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:46927 (local address 127.23.229.1:42935)
0809 19:00:36.235992 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.235994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.236005 (+ 11us) server_negotiation.cc:407] Connection header received
0809 19:00:36.236042 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.236043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.236054 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.236131 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.236317 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.236899 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.237848 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.238238 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.238294 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.238301 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.238483 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.238536 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 19:00:36.238669 21243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.235861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:41473 (local address 127.23.229.2:41219)
0809 19:00:36.235972 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.235974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.236133 (+ 159us) server_negotiation.cc:407] Connection header received
0809 19:00:36.236188 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.236189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.236200 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.236265 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.236425 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.236984 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.237916 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.238309 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.238385 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.238394 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.238553 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.238593 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 19:00:36.238714 21259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.235793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:41219 (local address 127.23.229.3:41473)
0809 19:00:36.236063 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.236073 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.236132 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.236289 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.236290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.236292 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.236368 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.236369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.237064 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.237065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.237819 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.237822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.238395 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.238396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.238472 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.238478 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.238538 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.238574 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":35,"thread_start_us":124,"threads_started":1}
I20260809 19:00:36.238971 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4e2f05024e4da280a764a093a8419f" candidate_uuid: "892c524ed2f14ce7b7ef17962125f5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" is_pre_election: true
I20260809 19:00:36.239140 20768 raft_consensus.cc:2454] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 892c524ed2f14ce7b7ef17962125f5b8 in term 0.
I20260809 19:00:36.239262 20953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4e2f05024e4da280a764a093a8419f" candidate_uuid: "892c524ed2f14ce7b7ef17962125f5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c8d2793b3844dfb1585a17309d0f96" is_pre_election: true
I20260809 19:00:36.239426 20953 raft_consensus.cc:2454] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 892c524ed2f14ce7b7ef17962125f5b8 in term 0.
I20260809 19:00:36.239418 21055 leader_election.cc:302] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 892c524ed2f14ce7b7ef17962125f5b8, be9dcbf8e4b64ed192c57f1b5e11bc77; no voters:
I20260809 19:00:36.239544 21258 raft_consensus.cc:2781] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:36.239600 21258 raft_consensus.cc:482] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:36.239627 21258 raft_consensus.cc:3037] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:36.240372 21258 raft_consensus.cc:504] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.240557 21258 leader_election.cc:288] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [CANDIDATE]: Term 1 election: Requested vote from peers be9dcbf8e4b64ed192c57f1b5e11bc77 (127.23.229.1:42935), d8c8d2793b3844dfb1585a17309d0f96 (127.23.229.2:41219)
I20260809 19:00:36.240689 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4e2f05024e4da280a764a093a8419f" candidate_uuid: "892c524ed2f14ce7b7ef17962125f5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77"
I20260809 19:00:36.240692 20953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4e2f05024e4da280a764a093a8419f" candidate_uuid: "892c524ed2f14ce7b7ef17962125f5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c8d2793b3844dfb1585a17309d0f96"
I20260809 19:00:36.240772 20953 raft_consensus.cc:3037] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:36.240787 20768 raft_consensus.cc:3037] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:36.241513 20768 raft_consensus.cc:2454] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c524ed2f14ce7b7ef17962125f5b8 in term 1.
I20260809 19:00:36.241592 20953 raft_consensus.cc:2454] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c524ed2f14ce7b7ef17962125f5b8 in term 1.
I20260809 19:00:36.241716 21055 leader_election.cc:302] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 892c524ed2f14ce7b7ef17962125f5b8, be9dcbf8e4b64ed192c57f1b5e11bc77; no voters:
I20260809 19:00:36.241807 21258 raft_consensus.cc:2781] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:36.241990 21258 raft_consensus.cc:686] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 892c524ed2f14ce7b7ef17962125f5b8, State: Running, Role: LEADER
I20260809 19:00:36.242089 21258 consensus_queue.cc:237] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } }
I20260809 19:00:36.242955 20555 catalog_manager.cc:5495] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 892c524ed2f14ce7b7ef17962125f5b8 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "892c524ed2f14ce7b7ef17962125f5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "892c524ed2f14ce7b7ef17962125f5b8" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 37691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 } health_report { overall_health: UNKNOWN } } }
I20260809 19:00:36.250730 21244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.248626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.23.229.3:37691)
0809 19:00:36.248668 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.248670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.248679 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:00:36.248744 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.248744 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.248761 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.248812 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:36.248926 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.249380 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.250109 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.250289 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.250336 (+ 47us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.250469 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:36.250558 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:36.250629 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.250668 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.250678 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 19:00:36.252434 20953 raft_consensus.cc:1261] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 1 FOLLOWER]: Refusing update from remote peer 892c524ed2f14ce7b7ef17962125f5b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:36.252462 20768 raft_consensus.cc:1261] T ed4e2f05024e4da280a764a093a8419f P be9dcbf8e4b64ed192c57f1b5e11bc77 [term 1 FOLLOWER]: Refusing update from remote peer 892c524ed2f14ce7b7ef17962125f5b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:36.252813 21261 consensus_queue.cc:1035] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be9dcbf8e4b64ed192c57f1b5e11bc77" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:36.252938 21258 consensus_queue.cc:1035] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c8d2793b3844dfb1585a17309d0f96" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 41219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:36.258814 21270 mvcc.cc:205] Tried to move back new op lower bound from 7316693140487491584 to 7316693140448231424. Current Snapshot: MvccSnapshot[applied={T|T < 7316693140487491584}]
I20260809 19:00:36.260643 21266 mvcc.cc:205] Tried to move back new op lower bound from 7316693140487491584 to 7316693140448231424. Current Snapshot: MvccSnapshot[applied={T|T < 7316693140487491584}]
I20260809 19:00:36.263700 20555 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:36.263814 20555 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:36.264716 20555 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eae70827e8d6499d860b19409ba2f12d: Sending DeleteTablet for 3 replicas of tablet ed4e2f05024e4da280a764a093a8419f
I20260809 19:00:36.265129 20922 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4e2f05024e4da280a764a093a8419f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:36 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:59038
I20260809 19:00:36.265208 20738 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4e2f05024e4da280a764a093a8419f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:36 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:36846
I20260809 19:00:36.265283 21119 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4e2f05024e4da280a764a093a8419f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:36 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:51484
I20260809 19:00:36.265424 21283 tablet_replica.cc:330] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: stopping tablet replica
I20260809 19:00:36.265530 21283 raft_consensus.cc:2229] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:36.265538 21286 tablet_replica.cc:330] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: stopping tablet replica
I20260809 19:00:36.265631 21286 raft_consensus.cc:2229] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:36.265643 21283 raft_consensus.cc:2258] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:36.265748 21286 raft_consensus.cc:2258] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:36.266175 21283 ts_tablet_manager.cc:1905] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:36.266355 21286 ts_tablet_manager.cc:1905] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:36.267163 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 20655
I20260809 19:00:36.268042 21286 ts_tablet_manager.cc:1918] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:36.268107 21286 log.cc:1196] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/ed4e2f05024e4da280a764a093a8419f
I20260809 19:00:36.268381 21286 ts_tablet_manager.cc:1939] T ed4e2f05024e4da280a764a093a8419f P 892c524ed2f14ce7b7ef17962125f5b8: Deleting consensus metadata
I20260809 19:00:36.270373 20534 catalog_manager.cc:4841] TS 892c524ed2f14ce7b7ef17962125f5b8 (127.23.229.3:37691): tablet ed4e2f05024e4da280a764a093a8419f (table test-table [id=cb6eba69eff6441f8f0d461dd81009f5]) successfully deleted
I20260809 19:00:36.272519 21283 ts_tablet_manager.cc:1918] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:36.272619 21283 log.cc:1196] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/ed4e2f05024e4da280a764a093a8419f
I20260809 19:00:36.272984 21283 ts_tablet_manager.cc:1939] T ed4e2f05024e4da280a764a093a8419f P d8c8d2793b3844dfb1585a17309d0f96: Deleting consensus metadata
I20260809 19:00:36.273566 20532 catalog_manager.cc:4841] TS d8c8d2793b3844dfb1585a17309d0f96 (127.23.229.2:41219): tablet ed4e2f05024e4da280a764a093a8419f (table test-table [id=cb6eba69eff6441f8f0d461dd81009f5]) successfully deleted
W20260809 19:00:36.290447 20530 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:42935 (error 108)
I20260809 19:00:36.291105 21234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.290951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:42935 (local address 127.0.0.1:36850)
0809 19:00:36.291018 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.291064 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:00:36.291235 20530 catalog_manager.cc:4584] TS be9dcbf8e4b64ed192c57f1b5e11bc77 (127.23.229.1:42935): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed4e2f05024e4da280a764a093a8419f: Network error: Client connection negotiation failed: client connection to 127.23.229.1:42935: connect: Connection refused (error 111)
I20260809 19:00:36.291656 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 20839
I20260809 19:00:36.312206 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 21033
I20260809 19:00:36.326397 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 20508
2026-08-09T19:00:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2303 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T19:00:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:36Z Disabled control of system clock
I20260809 19:00:36.363263 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40699
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:40699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:36.448002 21293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:36.448228 21293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:36.448251 21293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:36.449440 21293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:36.449481 21293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:36.449493 21293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:36.449506 21293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:36.449518 21293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:36.450891 21293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:40699
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:36.451159 21293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:36.451460 21293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:36.456301 21301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.456329 21304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.456327 21302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:36.456707 21293 server_base.cc:1034] running on GCE node
I20260809 19:00:36.457015 21293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:36.457304 21293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:36.458465 21293 hybrid_clock.cc:648] HybridClock initialized: now 1786302036458453 us; error 39 us; skew 500 ppm
I20260809 19:00:36.459694 21293 webserver.cc:460] Webserver started at http://127.23.229.62:43131/ using document root <none> and password file <none>
I20260809 19:00:36.459930 21293 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:36.460009 21293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:36.460158 21293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:36.461349 21293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "4d38f369d52c4cf6b060ea8e3a626378"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "8b7c5a50f8dbee6e417b18da099b80e9"
server_key_iv: "f1774784632c279d19ec8ee1148a0970"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.461714 21293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "4d38f369d52c4cf6b060ea8e3a626378"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "8b7c5a50f8dbee6e417b18da099b80e9"
server_key_iv: "f1774784632c279d19ec8ee1148a0970"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.463073 21293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 19:00:36.463778 21319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.463965 21293 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 19:00:36.464076 21293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "4d38f369d52c4cf6b060ea8e3a626378"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "8b7c5a50f8dbee6e417b18da099b80e9"
server_key_iv: "f1774784632c279d19ec8ee1148a0970"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.464150 21293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:36.474467 21293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:36.474761 21293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:36.474902 21293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:36.479056 21293 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:40699
I20260809 19:00:36.479087 21387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:40699 every 8 connection(s)
I20260809 19:00:36.479430 21293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:36.480399 21388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:36.482714 21388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378: Bootstrap starting.
I20260809 19:00:36.483255 21388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:36.483608 21388 log.cc:824] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:36.484409 21388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378: No bootstrap required, opened a new log
I20260809 19:00:36.486107 21388 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38f369d52c4cf6b060ea8e3a626378" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40699 } }
I20260809 19:00:36.486269 21388 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:36.486318 21388 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d38f369d52c4cf6b060ea8e3a626378, State: Initialized, Role: FOLLOWER
I20260809 19:00:36.486474 21388 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38f369d52c4cf6b060ea8e3a626378" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40699 } }
I20260809 19:00:36.486558 21388 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:36.486606 21388 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:36.486658 21388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:36.487200 21388 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38f369d52c4cf6b060ea8e3a626378" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40699 } }
I20260809 19:00:36.487322 21388 leader_election.cc:302] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d38f369d52c4cf6b060ea8e3a626378; no voters:
I20260809 19:00:36.487516 21388 leader_election.cc:288] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:36.487581 21392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:36.487776 21392 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [term 1 LEADER]: Becoming Leader. State: Replica: 4d38f369d52c4cf6b060ea8e3a626378, State: Running, Role: LEADER
I20260809 19:00:36.487838 21388 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:36.487978 21392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38f369d52c4cf6b060ea8e3a626378" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40699 } }
I20260809 19:00:36.488503 21393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d38f369d52c4cf6b060ea8e3a626378" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38f369d52c4cf6b060ea8e3a626378" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40699 } } }
I20260809 19:00:36.488672 21393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:36.488721 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 21293
I20260809 19:00:36.488831 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:36.489063 24468 external_mini_cluster.cc:1428] Setting key a156707ad2f1c4446b5132f023b1aac3
I20260809 19:00:36.489105 21394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d38f369d52c4cf6b060ea8e3a626378. Latest consensus state: current_term: 1 leader_uuid: "4d38f369d52c4cf6b060ea8e3a626378" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38f369d52c4cf6b060ea8e3a626378" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40699 } } }
I20260809 19:00:36.489180 21394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:36.489264 21401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:36.489940 21401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:36.491606 21401 catalog_manager.cc:1347] Generated new cluster ID: 0ef85b30df62472db721daa7cb9a4480
I20260809 19:00:36.491664 21401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:36.494972 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.489674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35666 (local address 127.23.229.62:40699)
0809 19:00:36.489911 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.489919 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.489943 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:00:36.490081 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.490089 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.490178 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.490320 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:36.490548 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.491859 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.492809 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.493274 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.493411 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.494189 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:36.494193 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:36.494194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:36.494390 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:36.494424 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:36.494436 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:36.494530 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.494611 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.494802 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260809 19:00:36.500905 21401 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:36.501471 21401 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:36.505375 21401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378: Generated new TSK 0
I20260809 19:00:36.505573 21401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:36.507094 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40699
--builtin_ntp_servers=127.23.229.20:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:36.592443 21422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:36.592728 21422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:36.592753 21422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:36.593945 21422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:36.593986 21422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:36.594012 21422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 19:00:36.595382 21422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:36.595656 21422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:36.595973 21422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:36.602100 21430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.602250 21434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:36.602278 21422 server_base.cc:1034] running on GCE node
W20260809 19:00:36.602108 21429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:36.602676 21422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:36.602969 21422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:36.604139 21422 hybrid_clock.cc:648] HybridClock initialized: now 1786302036604126 us; error 31 us; skew 500 ppm
I20260809 19:00:36.605492 21422 webserver.cc:460] Webserver started at http://127.23.229.1:40749/ using document root <none> and password file <none>
I20260809 19:00:36.605762 21422 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:36.605830 21422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:36.605980 21422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:36.607088 21422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "1a96651f0fa0433091f0c47e2c708825"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "ee7e269e326568b83d19fefb1e3baa5e"
server_key_iv: "256da31c0329172b7c6131cd76f73fab"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.607457 21422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "1a96651f0fa0433091f0c47e2c708825"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "ee7e269e326568b83d19fefb1e3baa5e"
server_key_iv: "256da31c0329172b7c6131cd76f73fab"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.608927 21422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:36.609725 21441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.609892 21422 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:36.610006 21422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "1a96651f0fa0433091f0c47e2c708825"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "ee7e269e326568b83d19fefb1e3baa5e"
server_key_iv: "256da31c0329172b7c6131cd76f73fab"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.610078 21422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:36.642580 21422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:36.642943 21422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:36.643143 21422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:36.643435 21422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:36.643810 21422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:36.643847 21422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.643872 21422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:36.643884 21422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.650028 21422 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:34773
I20260809 19:00:36.650066 21597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:34773 every 8 connection(s)
I20260809 19:00:36.650441 21422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:36.653439 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 21422
I20260809 19:00:36.653555 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 19:00:36.653753 24468 external_mini_cluster.cc:1428] Setting key c4540cb4184f42921733d4d134118074
I20260809 19:00:36.654789 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40699
--builtin_ntp_servers=127.23.229.20:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:00:36.656888 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.651263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:57523 (local address 127.23.229.62:40699)
0809 19:00:36.651341 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.651343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.651598 (+ 255us) server_negotiation.cc:407] Connection header received
0809 19:00:36.652174 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.652176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.652191 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.652245 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:36.653055 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.653835 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.655124 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.655447 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.655528 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.656575 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:36.656577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:36.656577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:36.656582 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:36.656606 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:36.656611 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:36.656672 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.656771 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.656808 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 19:00:36.657142 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.651258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40699 (local address 127.23.229.1:57523)
0809 19:00:36.651461 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.651505 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.652052 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.652324 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.652328 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.652336 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:36.652946 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.652952 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.653977 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.653978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.655039 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.655042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.655538 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.655539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.655691 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.656366 (+ 675us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:36.656366 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:36.656410 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:36.656455 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:36.656674 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:36.656682 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:36.656686 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.656773 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.656886 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260809 19:00:36.657599 21598 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40699
I20260809 19:00:36.657714 21598 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:36.657917 21598 heartbeater.cc:511] Master 127.23.229.62:40699 requested a full tablet report, sending...
I20260809 19:00:36.658469 21338 ts_manager.cc:194] Registered new tserver with Master: 1a96651f0fa0433091f0c47e2c708825 (127.23.229.1:34773)
I20260809 19:00:36.659119 21338 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.1:57523
W20260809 19:00:36.741227 21601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:36.741458 21601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:36.741495 21601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:36.742609 21601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:36.742677 21601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:36.742717 21601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 19:00:36.744081 21601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:36.744361 21601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:36.744688 21601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:36.749795 21608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:36.749967 21601 server_base.cc:1034] running on GCE node
W20260809 19:00:36.749809 21615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.749830 21609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:36.750265 21601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:36.750537 21601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:36.751693 21601 hybrid_clock.cc:648] HybridClock initialized: now 1786302036751678 us; error 40 us; skew 500 ppm
I20260809 19:00:36.753036 21601 webserver.cc:460] Webserver started at http://127.23.229.2:43755/ using document root <none> and password file <none>
I20260809 19:00:36.753302 21601 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:36.753378 21601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:36.753543 21601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:36.754684 21601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "e6dc3f4933584817bef75f7cc5d5574a"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "b26439b27f0a665b0d2a62acafb9b5e6"
server_key_iv: "1ed871498d74ad87e6846d9de83e2843"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.755064 21601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "e6dc3f4933584817bef75f7cc5d5574a"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "b26439b27f0a665b0d2a62acafb9b5e6"
server_key_iv: "1ed871498d74ad87e6846d9de83e2843"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.756366 21601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 19:00:36.757148 21623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.757318 21601 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:36.757416 21601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "e6dc3f4933584817bef75f7cc5d5574a"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "b26439b27f0a665b0d2a62acafb9b5e6"
server_key_iv: "1ed871498d74ad87e6846d9de83e2843"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.757498 21601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:36.790122 21601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:36.790488 21601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:36.790647 21601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:36.790917 21601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:36.791290 21601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:36.791348 21601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.791390 21601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:36.791412 21601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.797416 21601 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:34887
I20260809 19:00:36.797457 21782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:34887 every 8 connection(s)
I20260809 19:00:36.797854 21601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:36.801712 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 21601
I20260809 19:00:36.801829 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 19:00:36.802062 24468 external_mini_cluster.cc:1428] Setting key 984e139855204c712700488685939fcc
I20260809 19:00:36.803049 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40699
--builtin_ntp_servers=127.23.229.20:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:00:36.803738 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.798651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:60171 (local address 127.23.229.62:40699)
0809 19:00:36.798729 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.798731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.798974 (+ 243us) server_negotiation.cc:407] Connection header received
0809 19:00:36.799471 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.799473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.799488 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.799544 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:36.800248 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.800829 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.801999 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.802244 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.802325 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.803472 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:36.803474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:36.803474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:36.803479 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:36.803494 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:36.803499 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:36.803548 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.803627 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.803657 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:00:36.803958 21788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.798648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40699 (local address 127.23.229.2:60171)
0809 19:00:36.798846 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.798881 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.799384 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.799624 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.799628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.799637 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:36.800173 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.800177 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.800916 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.800917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.801915 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.801918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.802338 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.802340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.802518 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.803322 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:36.803322 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:36.803353 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:36.803376 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:36.803547 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:36.803553 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:36.803556 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.803617 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.803723 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260809 19:00:36.804402 21783 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40699
I20260809 19:00:36.804530 21783 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:36.804756 21783 heartbeater.cc:511] Master 127.23.229.62:40699 requested a full tablet report, sending...
I20260809 19:00:36.805153 21338 ts_manager.cc:194] Registered new tserver with Master: e6dc3f4933584817bef75f7cc5d5574a (127.23.229.2:34887)
I20260809 19:00:36.805526 21338 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.2:60171
W20260809 19:00:36.888098 21790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:36.888391 21790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:36.888429 21790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:36.889667 21790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:36.889724 21790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:36.889765 21790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 19:00:36.891134 21790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:40699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:36.891390 21790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:36.891695 21790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:36.896749 21797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.896787 21799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:36.896809 21796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:36.897037 21790 server_base.cc:1034] running on GCE node
I20260809 19:00:36.897254 21790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:36.897537 21790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:36.898705 21790 hybrid_clock.cc:648] HybridClock initialized: now 1786302036898694 us; error 44 us; skew 500 ppm
I20260809 19:00:36.900049 21790 webserver.cc:460] Webserver started at http://127.23.229.3:38241/ using document root <none> and password file <none>
I20260809 19:00:36.900326 21790 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:36.900400 21790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:36.900579 21790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:36.901729 21790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "77320c1bd2a94f0aa507e64cfa300e52"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "96293d82a0276de86e4c422cf5286f48"
server_key_iv: "f658d336d5b3f7b38ad8d211cb566bfc"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.902092 21790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "77320c1bd2a94f0aa507e64cfa300e52"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "96293d82a0276de86e4c422cf5286f48"
server_key_iv: "f658d336d5b3f7b38ad8d211cb566bfc"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.903412 21790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:36.904109 21810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.904278 21790 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:36.904383 21790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "77320c1bd2a94f0aa507e64cfa300e52"
format_stamp: "Formatted at 2026-08-09 19:00:36 on dist-test-slave-jq4t"
server_key: "96293d82a0276de86e4c422cf5286f48"
server_key_iv: "f658d336d5b3f7b38ad8d211cb566bfc"
server_key_version: "encryptionkey@0"
I20260809 19:00:36.904461 21790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:36.919777 21790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:36.920102 21790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:36.920259 21790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:36.920552 21790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:36.920900 21790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:36.920955 21790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.920998 21790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:36.921025 21790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:36.926842 21790 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:39903
I20260809 19:00:36.926900 21968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:39903 every 8 connection(s)
I20260809 19:00:36.927244 21790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 19:00:36.929534 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 21790
I20260809 19:00:36.929651 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 19:00:36.929872 24468 external_mini_cluster.cc:1428] Setting key bc0317a88a0d47c244666806df024562
I20260809 19:00:36.932953 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.928045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:58721 (local address 127.23.229.62:40699)
0809 19:00:36.928111 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.928113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.928320 (+ 207us) server_negotiation.cc:407] Connection header received
0809 19:00:36.928811 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.928812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.928825 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.928892 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:36.929779 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.930411 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.931486 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.931700 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.931787 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.932661 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:36.932662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:36.932663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:36.932668 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:36.932685 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:36.932690 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:36.932741 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.932832 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.932862 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 19:00:36.933177 21973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.927987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40699 (local address 127.23.229.3:58721)
0809 19:00:36.928176 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.928217 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.928721 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.928946 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.928950 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.928959 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:36.929615 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.929624 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.930516 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.930518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.931361 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.931363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.931800 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.931801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.931939 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.932468 (+ 529us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:36.932468 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:36.932546 (+ 78us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:36.932572 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:36.932746 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:36.932751 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:36.932755 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.932834 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.932942 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260809 19:00:36.933629 21970 heartbeater.cc:347] Connected to a master server at 127.23.229.62:40699
I20260809 19:00:36.933723 21970 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:36.933907 21970 heartbeater.cc:511] Master 127.23.229.62:40699 requested a full tablet report, sending...
I20260809 19:00:36.934285 21338 ts_manager.cc:194] Registered new tserver with Master: 77320c1bd2a94f0aa507e64cfa300e52 (127.23.229.3:39903)
I20260809 19:00:36.934667 21338 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.3:58721
I20260809 19:00:36.941759 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:36.946123 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.943227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35678 (local address 127.23.229.62:40699)
0809 19:00:36.943297 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.943299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.943400 (+ 101us) server_negotiation.cc:407] Connection header received
0809 19:00:36.943448 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.943448 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.943457 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.943512 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:36.943662 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.944150 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.944938 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.945125 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.945177 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.945839 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:36.945841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:36.945841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:36.945845 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:36.945859 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:36.945863 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:36.945945 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.946012 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.946023 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 19:00:36.947731 21338 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:36.949434 21338 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:36.956444 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.952054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.23.229.1:34773)
0809 19:00:36.952681 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.952686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.952700 (+ 14us) server_negotiation.cc:407] Connection header received
0809 19:00:36.952745 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.952748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.952766 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.952849 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.953105 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.954287 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.955505 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.956020 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.956112 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.956221 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.956300 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.956350 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":99,"threads_started":1}
I20260809 19:00:36.956434 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.951925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34773 (local address 127.0.0.1:55894)
0809 19:00:36.952256 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.952292 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.952391 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.952947 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.952948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.952951 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.953019 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.953021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.954386 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.954387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.955416 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.955417 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.956111 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.956112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.956191 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.956204 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.956284 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.956346 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":3,"thread_start_us":143,"threads_started":1}
I20260809 19:00:36.956574 21981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.951931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:39903 (local address 127.0.0.1:37690)
0809 19:00:36.952557 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.952566 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.952645 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.952941 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.952945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.952948 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.953037 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.953040 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.954416 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.954417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.955387 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.955391 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.956341 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.956342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.956392 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.956395 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.956441 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.956470 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":30,"thread_start_us":98,"threads_started":1}
I20260809 19:00:36.956684 21984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.952387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.23.229.2:34887)
0809 19:00:36.952727 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.952732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.952742 (+ 10us) server_negotiation.cc:407] Connection header received
0809 19:00:36.952782 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.952784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.952801 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.952884 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.953123 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.953911 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.955322 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.956092 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.956168 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.956261 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.956545 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.956588 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":135,"threads_started":1}
I20260809 19:00:36.956744 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.951931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:34887 (local address 127.0.0.1:40178)
0809 19:00:36.952525 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.952535 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.952583 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.952956 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.952957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.952959 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.953037 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.953040 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.954006 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.954008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.955227 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.955230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.956302 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.956303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.956370 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.956373 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.956426 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.956470 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":3,"thread_start_us":64,"threads_started":1}
I20260809 19:00:36.956898 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.952209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37690 (local address 127.23.229.3:39903)
0809 19:00:36.952406 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.952411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.952619 (+ 208us) server_negotiation.cc:407] Connection header received
0809 19:00:36.952745 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.952748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.952766 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.952821 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.953148 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.954325 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.955499 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.956180 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.956238 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.956312 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.956748 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.956800 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":92,"threads_started":1}
I20260809 19:00:36.957669 21693 tablet_service.cc:1467] Processing CreateTablet for tablet 8c1e09903ff949ebae390214e3c235be (DEFAULT_TABLE table=test-table [id=f22490cf6a46485eb7d6416f75cc1174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:36.957670 21882 tablet_service.cc:1467] Processing CreateTablet for tablet 8c1e09903ff949ebae390214e3c235be (DEFAULT_TABLE table=test-table [id=f22490cf6a46485eb7d6416f75cc1174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:36.957724 21513 tablet_service.cc:1467] Processing CreateTablet for tablet 8c1e09903ff949ebae390214e3c235be (DEFAULT_TABLE table=test-table [id=f22490cf6a46485eb7d6416f75cc1174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:36.958045 21693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c1e09903ff949ebae390214e3c235be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:36.958045 21882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c1e09903ff949ebae390214e3c235be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:36.958045 21513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c1e09903ff949ebae390214e3c235be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:36.961076 21986 tablet_bootstrap.cc:492] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Bootstrap starting.
I20260809 19:00:36.961436 21987 tablet_bootstrap.cc:492] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Bootstrap starting.
I20260809 19:00:36.961632 21988 tablet_bootstrap.cc:492] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825: Bootstrap starting.
I20260809 19:00:36.962206 21988 tablet_bootstrap.cc:654] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:36.962267 21987 tablet_bootstrap.cc:654] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:36.962266 21986 tablet_bootstrap.cc:654] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:36.962532 21988 log.cc:824] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:36.962606 21987 log.cc:824] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:36.962606 21986 log.cc:824] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:36.963384 21988 tablet_bootstrap.cc:492] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825: No bootstrap required, opened a new log
I20260809 19:00:36.963377 21987 tablet_bootstrap.cc:492] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: No bootstrap required, opened a new log
I20260809 19:00:36.963467 21988 ts_tablet_manager.cc:1397] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:00:36.963621 21986 tablet_bootstrap.cc:492] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: No bootstrap required, opened a new log
I20260809 19:00:36.963630 21987 ts_tablet_manager.cc:1397] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:36.963692 21986 ts_tablet_manager.cc:1397] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 19:00:36.965639 21986 raft_consensus.cc:348] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.965801 21986 raft_consensus.cc:374] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:36.965847 21986 raft_consensus.cc:729] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dc3f4933584817bef75f7cc5d5574a, State: Initialized, Role: FOLLOWER
I20260809 19:00:36.965991 21986 consensus_queue.cc:260] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.966249 21986 ts_tablet_manager.cc:1428] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:36.966394 21783 heartbeater.cc:503] Master 127.23.229.62:40699 was elected leader, sending a full tablet report...
I20260809 19:00:36.966239 21988 raft_consensus.cc:348] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.966455 21988 raft_consensus.cc:374] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:36.966396 21987 raft_consensus.cc:348] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.966538 21987 raft_consensus.cc:374] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:36.966547 21988 raft_consensus.cc:729] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a96651f0fa0433091f0c47e2c708825, State: Initialized, Role: FOLLOWER
I20260809 19:00:36.966586 21987 raft_consensus.cc:729] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77320c1bd2a94f0aa507e64cfa300e52, State: Initialized, Role: FOLLOWER
I20260809 19:00:36.966674 21988 consensus_queue.cc:260] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.966825 21987 consensus_queue.cc:260] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.966957 21988 ts_tablet_manager.cc:1428] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 19:00:36.966993 21598 heartbeater.cc:503] Master 127.23.229.62:40699 was elected leader, sending a full tablet report...
I20260809 19:00:36.967082 21987 ts_tablet_manager.cc:1428] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 19:00:36.967212 21970 heartbeater.cc:503] Master 127.23.229.62:40699 was elected leader, sending a full tablet report...
I20260809 19:00:36.985036 21994 raft_consensus.cc:482] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:36.985181 21994 raft_consensus.cc:504] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.985531 21994 leader_election.cc:288] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77320c1bd2a94f0aa507e64cfa300e52 (127.23.229.3:39903), e6dc3f4933584817bef75f7cc5d5574a (127.23.229.2:34887)
I20260809 19:00:36.988749 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.985755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:39903 (local address 127.23.229.1:60509)
0809 19:00:36.985818 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.985831 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.985879 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.986084 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.986085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.986087 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.986171 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.986173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.986851 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.986853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.987818 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.987822 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.988445 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.988447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.988559 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.988592 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.988645 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.988690 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":41}
I20260809 19:00:36.988837 21984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.985836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:58723 (local address 127.23.229.2:34887)
0809 19:00:36.985891 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.985893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.986069 (+ 176us) server_negotiation.cc:407] Connection header received
0809 19:00:36.986108 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.986109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.986122 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.986184 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.986364 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.986844 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.988028 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.988430 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.988531 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.988540 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.988721 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.988763 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 19:00:36.988864 21998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.985755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:34887 (local address 127.23.229.1:58723)
0809 19:00:36.985983 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:36.985994 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:36.986060 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:36.986193 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:36.986194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:36.986195 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:36.986289 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.986291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.986926 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.986927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.987900 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:36.987903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.988533 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.988535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:36.988639 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.988642 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:36.988714 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 19:00:36.988753 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":14,"thread_start_us":145,"threads_started":1}
I20260809 19:00:36.989035 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.985863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:60509 (local address 127.23.229.3:39903)
0809 19:00:36.985917 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.985919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.985930 (+ 11us) server_negotiation.cc:407] Connection header received
0809 19:00:36.985968 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.985969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.985980 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.986065 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:36.986247 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.986773 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.987926 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:36.988340 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:36.988432 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:36.988441 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:36.988887 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 19:00:36.988951 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 19:00:36.989264 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1e09903ff949ebae390214e3c235be" candidate_uuid: "1a96651f0fa0433091f0c47e2c708825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dc3f4933584817bef75f7cc5d5574a" is_pre_election: true
I20260809 19:00:36.989449 21726 raft_consensus.cc:2454] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a96651f0fa0433091f0c47e2c708825 in term 0.
I20260809 19:00:36.989557 21907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1e09903ff949ebae390214e3c235be" candidate_uuid: "1a96651f0fa0433091f0c47e2c708825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77320c1bd2a94f0aa507e64cfa300e52" is_pre_election: true
I20260809 19:00:36.989717 21907 raft_consensus.cc:2454] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a96651f0fa0433091f0c47e2c708825 in term 0.
I20260809 19:00:36.989702 21446 leader_election.cc:302] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a96651f0fa0433091f0c47e2c708825, e6dc3f4933584817bef75f7cc5d5574a; no voters:
I20260809 19:00:36.989830 21994 raft_consensus.cc:2781] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:36.989914 21994 raft_consensus.cc:482] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:36.989952 21994 raft_consensus.cc:3037] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:36.990715 21994 raft_consensus.cc:504] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.990880 21994 leader_election.cc:288] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [CANDIDATE]: Term 1 election: Requested vote from peers 77320c1bd2a94f0aa507e64cfa300e52 (127.23.229.3:39903), e6dc3f4933584817bef75f7cc5d5574a (127.23.229.2:34887)
I20260809 19:00:36.991027 21907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1e09903ff949ebae390214e3c235be" candidate_uuid: "1a96651f0fa0433091f0c47e2c708825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77320c1bd2a94f0aa507e64cfa300e52"
I20260809 19:00:36.991041 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1e09903ff949ebae390214e3c235be" candidate_uuid: "1a96651f0fa0433091f0c47e2c708825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6dc3f4933584817bef75f7cc5d5574a"
I20260809 19:00:36.991122 21907 raft_consensus.cc:3037] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:36.991117 21726 raft_consensus.cc:3037] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:36.991832 21726 raft_consensus.cc:2454] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a96651f0fa0433091f0c47e2c708825 in term 1.
I20260809 19:00:36.991859 21907 raft_consensus.cc:2454] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a96651f0fa0433091f0c47e2c708825 in term 1.
I20260809 19:00:36.991994 21446 leader_election.cc:302] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a96651f0fa0433091f0c47e2c708825, e6dc3f4933584817bef75f7cc5d5574a; no voters:
I20260809 19:00:36.992082 21994 raft_consensus.cc:2781] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:36.992301 21994 raft_consensus.cc:686] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 1 LEADER]: Becoming Leader. State: Replica: 1a96651f0fa0433091f0c47e2c708825, State: Running, Role: LEADER
I20260809 19:00:36.992406 21994 consensus_queue.cc:237] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } }
I20260809 19:00:36.993340 21336 catalog_manager.cc:5495] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a96651f0fa0433091f0c47e2c708825 (127.23.229.1). New cstate: current_term: 1 leader_uuid: "1a96651f0fa0433091f0c47e2c708825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a96651f0fa0433091f0c47e2c708825" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 34773 } health_report { overall_health: HEALTHY } } }
I20260809 19:00:37.001875 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:36.999573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55910 (local address 127.23.229.1:34773)
0809 19:00:36.999633 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:36.999635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:36.999643 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:00:36.999697 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:36.999697 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:36.999714 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:36.999776 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:36.999969 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:37.000412 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:37.001186 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:37.001366 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:37.001418 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:37.001542 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:37.001632 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:37.001700 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:37.001742 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 19:00:37.001752 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 19:00:37.003695 21726 raft_consensus.cc:1261] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 1 FOLLOWER]: Refusing update from remote peer 1a96651f0fa0433091f0c47e2c708825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:37.003695 21907 raft_consensus.cc:1261] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 1 FOLLOWER]: Refusing update from remote peer 1a96651f0fa0433091f0c47e2c708825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:37.004086 21999 consensus_queue.cc:1035] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6dc3f4933584817bef75f7cc5d5574a" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 34887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:37.004227 21994 consensus_queue.cc:1035] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77320c1bd2a94f0aa507e64cfa300e52" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:37.007596 22008 mvcc.cc:205] Tried to move back new op lower bound from 7316693143564324864 to 7316693143521746944. Current Snapshot: MvccSnapshot[applied={T|T < 7316693143564324864}]
I20260809 19:00:37.007395 22006 mvcc.cc:205] Tried to move back new op lower bound from 7316693143564324864 to 7316693143521746944. Current Snapshot: MvccSnapshot[applied={T|T < 7316693143564324864 or (T in {7316693143564324864})}]
I20260809 19:00:37.009690 21337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:37.009795 21337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:37.010615 21337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d38f369d52c4cf6b060ea8e3a626378: Sending DeleteTablet for 3 replicas of tablet 8c1e09903ff949ebae390214e3c235be
I20260809 19:00:37.010974 21693 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c1e09903ff949ebae390214e3c235be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:37 UTC) from {username='slave'} at 127.0.0.1:40178
I20260809 19:00:37.011003 21882 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c1e09903ff949ebae390214e3c235be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:37 UTC) from {username='slave'} at 127.0.0.1:37690
I20260809 19:00:37.011009 21513 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c1e09903ff949ebae390214e3c235be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:37 UTC) from {username='slave'} at 127.0.0.1:55894
I20260809 19:00:37.011224 22020 tablet_replica.cc:330] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: stopping tablet replica
I20260809 19:00:37.011312 22018 tablet_replica.cc:330] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: stopping tablet replica
I20260809 19:00:37.011343 22020 raft_consensus.cc:2229] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:37.011406 22018 raft_consensus.cc:2229] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:37.011446 22020 raft_consensus.cc:2258] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:37.011529 22018 raft_consensus.cc:2258] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:37.011683 22019 tablet_replica.cc:330] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825: stopping tablet replica
I20260809 19:00:37.011760 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 21422
I20260809 19:00:37.011775 22019 raft_consensus.cc:2229] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:37.011860 22019 raft_consensus.cc:2258] T 8c1e09903ff949ebae390214e3c235be P 1a96651f0fa0433091f0c47e2c708825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:37.019979 22018 ts_tablet_manager.cc:1905] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:37.020135 22020 ts_tablet_manager.cc:1905] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:37.021657 22020 ts_tablet_manager.cc:1918] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:37.021754 22020 log.cc:1196] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/8c1e09903ff949ebae390214e3c235be
I20260809 19:00:37.022022 22020 ts_tablet_manager.cc:1939] T 8c1e09903ff949ebae390214e3c235be P e6dc3f4933584817bef75f7cc5d5574a: Deleting consensus metadata
I20260809 19:00:37.022058 22018 ts_tablet_manager.cc:1918] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:37.022140 22018 log.cc:1196] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/8c1e09903ff949ebae390214e3c235be
I20260809 19:00:37.022394 22018 ts_tablet_manager.cc:1939] T 8c1e09903ff949ebae390214e3c235be P 77320c1bd2a94f0aa507e64cfa300e52: Deleting consensus metadata
I20260809 19:00:37.022531 21323 catalog_manager.cc:4841] TS e6dc3f4933584817bef75f7cc5d5574a (127.23.229.2:34887): tablet 8c1e09903ff949ebae390214e3c235be (table test-table [id=f22490cf6a46485eb7d6416f75cc1174]) successfully deleted
I20260809 19:00:37.022830 21322 catalog_manager.cc:4841] TS 77320c1bd2a94f0aa507e64cfa300e52 (127.23.229.3:39903): tablet 8c1e09903ff949ebae390214e3c235be (table test-table [id=f22490cf6a46485eb7d6416f75cc1174]) successfully deleted
W20260809 19:00:37.025240 21321 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:34773 (error 108)
I20260809 19:00:37.025550 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 21601
I20260809 19:00:37.028118 21981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:37.025643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:34773 (local address 127.0.0.1:55914)
0809 19:00:37.028024 (+ 2381us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:37.028077 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2353}
W20260809 19:00:37.033102 21321 catalog_manager.cc:4584] TS 1a96651f0fa0433091f0c47e2c708825 (127.23.229.1:34773): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8c1e09903ff949ebae390214e3c235be: Network error: Client connection negotiation failed: client connection to 127.23.229.1:34773: connect: Connection refused (error 111)
I20260809 19:00:37.041812 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 21790
I20260809 19:00:37.052529 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 21293
2026-08-09T19:00:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (723 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:37 dist-test-slave-jq4t krb5kdc[22029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:37 dist-test-slave-jq4t krb5kdc[22029](info): set up 2 sockets
Aug 09 19:00:37 dist-test-slave-jq4t krb5kdc[22029](info): commencing operation
krb5kdc: starting...
W20260809 19:00:38.320412 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:38 dist-test-slave-jq4t krb5kdc[22029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:00:38.449357 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42927
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:38.535984 22046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:38.536242 22046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:38.536283 22046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:38.537545 22046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:38.537616 22046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:38.537640 22046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:38.537662 22046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:38.537690 22046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:38.539208 22046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:38.539501 22046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:38.539744 22046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:38.544945 22056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:38.544917 22055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:38.544958 22058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:38.545158 22046 server_base.cc:1034] running on GCE node
I20260809 19:00:38.545434 22046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:38.545770 22046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:38.546924 22046 hybrid_clock.cc:648] HybridClock initialized: now 1786302038546907 us; error 45 us; skew 500 ppm
Aug 09 19:00:38 dist-test-slave-jq4t krb5kdc[22029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302038, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:38.552341 22046 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:00:38.552812 22046 webserver.cc:460] Webserver started at http://127.23.229.62:43057/ using document root <none> and password file <none>
I20260809 19:00:38.553033 22046 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:38.553076 22046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:38.553164 22046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:38.554184 22046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "26b27555f61c4a079da240c4aa0c075e"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "4434bfe911c31a602ac300b06e4155b1"
server_key_iv: "10d0f70ecf525067abe9ff29eb7f2712"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.554497 22046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "26b27555f61c4a079da240c4aa0c075e"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "4434bfe911c31a602ac300b06e4155b1"
server_key_iv: "10d0f70ecf525067abe9ff29eb7f2712"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.555850 22046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:00:38.556604 22066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:38.556785 22046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:00:38.556880 22046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "26b27555f61c4a079da240c4aa0c075e"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "4434bfe911c31a602ac300b06e4155b1"
server_key_iv: "10d0f70ecf525067abe9ff29eb7f2712"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.556970 22046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:38.585800 22046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:38.588343 22046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:38.588591 22046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:38.592942 22046 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:42927
I20260809 19:00:38.592991 22152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:42927 every 8 connection(s)
I20260809 19:00:38.593403 22046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:38.594381 22153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:38.595710 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 22046
I20260809 19:00:38.595829 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:38.596032 24468 external_mini_cluster.cc:1428] Setting key 6e1e95c33be9304a00e92a9a446b7f9b
I20260809 19:00:38.597394 22153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e: Bootstrap starting.
I20260809 19:00:38.598130 22153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:38.598466 22153 log.cc:824] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:38.599303 22153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e: No bootstrap required, opened a new log
I20260809 19:00:38.601745 22153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b27555f61c4a079da240c4aa0c075e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42927 } }
I20260809 19:00:38.601919 22153 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:38.601967 22153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b27555f61c4a079da240c4aa0c075e, State: Initialized, Role: FOLLOWER
I20260809 19:00:38.602126 22153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b27555f61c4a079da240c4aa0c075e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42927 } }
I20260809 19:00:38.602232 22153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:38.602279 22153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:38.602335 22153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:38.602922 22153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b27555f61c4a079da240c4aa0c075e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42927 } }
I20260809 19:00:38.603060 22153 leader_election.cc:302] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26b27555f61c4a079da240c4aa0c075e; no voters:
I20260809 19:00:38.603273 22153 leader_election.cc:288] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:38.603324 22159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:38.603550 22159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [term 1 LEADER]: Becoming Leader. State: Replica: 26b27555f61c4a079da240c4aa0c075e, State: Running, Role: LEADER
I20260809 19:00:38.603591 22153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:38.603689 22159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b27555f61c4a079da240c4aa0c075e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42927 } }
Aug 09 19:00:38 dist-test-slave-jq4t krb5kdc[22029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:38.604063 22159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26b27555f61c4a079da240c4aa0c075e. Latest consensus state: current_term: 1 leader_uuid: "26b27555f61c4a079da240c4aa0c075e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b27555f61c4a079da240c4aa0c075e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42927 } } }
I20260809 19:00:38.604079 22160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26b27555f61c4a079da240c4aa0c075e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b27555f61c4a079da240c4aa0c075e" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42927 } } }
I20260809 19:00:38.604261 22160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:38.604521 22159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:38.604667 22170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:38.605768 22170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:38.608853 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:38.596665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52294 (local address 127.23.229.62:42927)
0809 19:00:38.596877 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:38.596887 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:38.596928 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:00:38.597506 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:38.597517 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:38.597583 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:38.597738 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:38.598395 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.599835 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.600648 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.601346 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.601496 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:38.604421 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:38.604425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:38.604426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:38.604441 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:38.606749 (+ 2308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:38.607220 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:38.607224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:38.607225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:38.607372 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:38.607638 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:38.607639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:38.607640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:38.608065 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:38.608224 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:38.608371 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 19:00:38.608567 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260809 19:00:38.610687 22170 catalog_manager.cc:1347] Generated new cluster ID: c378796d1dd248d0a97b5ee8138e0d02
I20260809 19:00:38.610749 22170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:38.649937 22170 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:38.650779 22170 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:38.653438 22170 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e: Generated new TSK 0
I20260809 19:00:38.653721 22170 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.229.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
Entry for principal kudu/127.23.229.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab.
I20260809 19:00:38.691524 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42927
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:38.780130 22187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:38.780344 22187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:38.780367 22187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:38.781538 22187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:38.781584 22187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:38.781610 22187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 19:00:38.783077 22187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.1.keytab
--principal=kudu/127.23.229.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:38.783289 22187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:38.783509 22187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:38.788830 22201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:38.788827 22198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:38.788825 22199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:38.788967 22187 server_base.cc:1034] running on GCE node
I20260809 19:00:38.789297 22187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:38.789585 22187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:38.790779 22187 hybrid_clock.cc:648] HybridClock initialized: now 1786302038790759 us; error 33 us; skew 500 ppm
Aug 09 19:00:38 dist-test-slave-jq4t krb5kdc[22029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302038, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:38.793488 22187 init.cc:377] Logged in from keytab as kudu/127.23.229.1@KRBTEST.COM (short username kudu)
I20260809 19:00:38.793933 22187 webserver.cc:460] Webserver started at http://127.23.229.1:37845/ using document root <none> and password file <none>
I20260809 19:00:38.794173 22187 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:38.794241 22187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:38.794399 22187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:38.795487 22187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "28ed2ea9d77e4b1c82417f095c463d96"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "8db04c7a7df7a7193433729ffac7fd39"
server_key_iv: "1b75f71b51ad757a223a7fc893749f42"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.795859 22187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "28ed2ea9d77e4b1c82417f095c463d96"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "8db04c7a7df7a7193433729ffac7fd39"
server_key_iv: "1b75f71b51ad757a223a7fc893749f42"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.797319 22187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:38.798112 22212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:38.798302 22187 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:38.798411 22187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "28ed2ea9d77e4b1c82417f095c463d96"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "8db04c7a7df7a7193433729ffac7fd39"
server_key_iv: "1b75f71b51ad757a223a7fc893749f42"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.798496 22187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:38.805684 22187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:38.807536 22187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:38.807700 22187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:38.807938 22187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:38.808250 22187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:38.808305 22187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:38.808350 22187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:38.808375 22187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:38.814728 22187 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:35927
I20260809 19:00:38.814781 22367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:35927 every 8 connection(s)
I20260809 19:00:38.815166 22187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:38.818528 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 22187
I20260809 19:00:38.818660 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 19:00:38.818848 24468 external_mini_cluster.cc:1428] Setting key a79a665057dd8d331e1958b5d0edd713
Aug 09 19:00:38 dist-test-slave-jq4t krb5kdc[22029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302038, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.1@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:38.826665 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:38.815949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:52589 (local address 127.23.229.62:42927)
0809 19:00:38.816009 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:38.816011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:38.816205 (+ 194us) server_negotiation.cc:407] Connection header received
0809 19:00:38.816924 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:38.816926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:38.816937 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:38.816993 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:38.818192 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.818934 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.820577 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.820785 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.820842 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:38.823468 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:38.823469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:38.823469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:38.823477 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:38.824978 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:38.825526 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:38.825526 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:38.825527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:38.825581 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:38.825908 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:38.825909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:38.825909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:38.826025 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:38.826080 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:38.826514 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 19:00:38.826594 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 19:00:38.827039 22371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:38.815919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42927 (local address 127.23.229.1:52589)
0809 19:00:38.816081 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:38.816126 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:38.816823 (+ 697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:38.817067 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:38.817071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:38.817814 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:38.818092 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:38.818098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.819187 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.819188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:38.820466 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:38.820469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.820875 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.820876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:38.821026 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:38.821679 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:38.821688 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:38.823362 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:38.825070 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:38.825078 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:38.825081 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:38.825443 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:38.825654 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:38.825656 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:38.825656 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:38.825823 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:38.826122 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:38.826132 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:38.826330 (+ 198us) client_negotiation.cc:769] Sending connection context
0809 19:00:38.826484 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 19:00:38.826699 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260809 19:00:38.827658 22369 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42927
I20260809 19:00:38.827783 22369 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:38.828011 22369 heartbeater.cc:511] Master 127.23.229.62:42927 requested a full tablet report, sending...
I20260809 19:00:38.828675 22090 ts_manager.cc:194] Registered new tserver with Master: 28ed2ea9d77e4b1c82417f095c463d96 (127.23.229.1:35927)
I20260809 19:00:38.829301 22090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.1@KRBTEST.COM'} at 127.23.229.1:52589
WARNING: no policy specified for kudu/127.23.229.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
Entry for principal kudu/127.23.229.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab.
I20260809 19:00:38.847242 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42927
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:38.933590 22374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:38.933872 22374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:38.933916 22374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:38.935099 22374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:38.935180 22374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:38.935225 22374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 19:00:38.936781 22374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.2.keytab
--principal=kudu/127.23.229.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:38.937089 22374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:38.937345 22374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:38.942700 22382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:38.942708 22384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:38.942708 22381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:38.942948 22374 server_base.cc:1034] running on GCE node
I20260809 19:00:38.943177 22374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:38.943435 22374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:38.944617 22374 hybrid_clock.cc:648] HybridClock initialized: now 1786302038944589 us; error 40 us; skew 500 ppm
Aug 09 19:00:38 dist-test-slave-jq4t krb5kdc[22029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302038, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:38.947624 22374 init.cc:377] Logged in from keytab as kudu/127.23.229.2@KRBTEST.COM (short username kudu)
I20260809 19:00:38.948097 22374 webserver.cc:460] Webserver started at http://127.23.229.2:36427/ using document root <none> and password file <none>
I20260809 19:00:38.948319 22374 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:38.948362 22374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:38.948457 22374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:38.949579 22374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "5b4b2abb3635451b9b8987272a9c1c42"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "4f43b959a1d1b931cc7f92dbbac6c587"
server_key_iv: "1a9c479f63f5214551e6d6d20db3d9da"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.949892 22374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "5b4b2abb3635451b9b8987272a9c1c42"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "4f43b959a1d1b931cc7f92dbbac6c587"
server_key_iv: "1a9c479f63f5214551e6d6d20db3d9da"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.951212 22374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 19:00:38.951897 22394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:38.952075 22374 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 19:00:38.952167 22374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "5b4b2abb3635451b9b8987272a9c1c42"
format_stamp: "Formatted at 2026-08-09 19:00:38 on dist-test-slave-jq4t"
server_key: "4f43b959a1d1b931cc7f92dbbac6c587"
server_key_iv: "1a9c479f63f5214551e6d6d20db3d9da"
server_key_version: "encryptionkey@0"
I20260809 19:00:38.952219 22374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:38.975149 22374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:38.977376 22374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:38.977504 22374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:38.977723 22374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:38.978061 22374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:38.978102 22374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:38.978125 22374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:38.978137 22374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:38.984233 22374 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:45513
I20260809 19:00:38.984280 22544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:45513 every 8 connection(s)
I20260809 19:00:38.984685 22374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
Aug 09 19:00:38 dist-test-slave-jq4t krb5kdc[22029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302038, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.2@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:38.993664 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 22374
I20260809 19:00:38.993789 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 19:00:38.994031 24468 external_mini_cluster.cc:1428] Setting key 656993738bfb931be655b8f190ecefad
I20260809 19:00:38.994283 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:38.985422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:48697 (local address 127.23.229.62:42927)
0809 19:00:38.985511 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:38.985514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:38.985679 (+ 165us) server_negotiation.cc:407] Connection header received
0809 19:00:38.986203 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:38.986204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:38.986217 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:38.986281 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:38.987251 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.987756 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.988869 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.989062 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.989120 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:38.991331 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:38.991333 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:38.991333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:38.991340 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:38.992827 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:38.993186 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:38.993187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:38.993187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:38.993240 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:38.993467 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:38.993468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:38.993468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:38.993629 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:38.993708 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:38.994053 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 19:00:38.994199 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:00:38.994441 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:38.985378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42927 (local address 127.23.229.2:48697)
0809 19:00:38.985549 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:38.985590 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:38.986074 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:38.986363 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:38.986366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:38.986962 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:38.987161 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:38.987166 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.987849 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.987850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:38.988777 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:38.988780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:38.989138 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:38.989138 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:38.989242 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:38.989782 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:38.989790 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:38.991237 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:38.992898 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:38.992904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:38.992906 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:38.993120 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:38.993300 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:38.993301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:38.993301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:38.993400 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:38.993703 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:38.993707 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:38.993909 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 19:00:38.993999 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 19:00:38.994172 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":103,"threads_started":1}
I20260809 19:00:38.996621 22545 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42927
I20260809 19:00:38.996745 22545 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:38.996948 22545 heartbeater.cc:511] Master 127.23.229.62:42927 requested a full tablet report, sending...
I20260809 19:00:38.997429 22090 ts_manager.cc:194] Registered new tserver with Master: 5b4b2abb3635451b9b8987272a9c1c42 (127.23.229.2:45513)
I20260809 19:00:38.997833 22090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.2@KRBTEST.COM'} at 127.23.229.2:48697
WARNING: no policy specified for kudu/127.23.229.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
Entry for principal kudu/127.23.229.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab.
I20260809 19:00:39.019368 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42927
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:39.104842 22553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:39.105135 22553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:39.105181 22553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:39.106520 22553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:39.106600 22553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:39.106648 22553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 19:00:39.108203 22553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.3.keytab
--principal=kudu/127.23.229.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:42927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:39.108565 22553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:39.108847 22553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:39.114099 22563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:39.114111 22560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:39.114161 22553 server_base.cc:1034] running on GCE node
W20260809 19:00:39.114099 22567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:39.114481 22553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:39.114771 22553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:39.115918 22553 hybrid_clock.cc:648] HybridClock initialized: now 1786302039115906 us; error 30 us; skew 500 ppm
Aug 09 19:00:39 dist-test-slave-jq4t krb5kdc[22029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302039, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:39.118685 22553 init.cc:377] Logged in from keytab as kudu/127.23.229.3@KRBTEST.COM (short username kudu)
I20260809 19:00:39.119153 22553 webserver.cc:460] Webserver started at http://127.23.229.3:45845/ using document root <none> and password file <none>
I20260809 19:00:39.119410 22553 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:39.119459 22553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:39.119632 22553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:39.120779 22553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "9a96bf218f9d46879cdedd808628e3fd"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "09858e9c3c8866ad8add82a93aadfd37"
server_key_iv: "b02e6f68e7c7469419393e158438ec4d"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.121157 22553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "9a96bf218f9d46879cdedd808628e3fd"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "09858e9c3c8866ad8add82a93aadfd37"
server_key_iv: "b02e6f68e7c7469419393e158438ec4d"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.122499 22553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:39.123234 22574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.123426 22553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:39.123528 22553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "9a96bf218f9d46879cdedd808628e3fd"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "09858e9c3c8866ad8add82a93aadfd37"
server_key_iv: "b02e6f68e7c7469419393e158438ec4d"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.123602 22553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:39.147528 22553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:39.150182 22553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:39.150352 22553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:39.150635 22553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:39.151046 22553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:39.151084 22553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.151108 22553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:39.151139 22553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.157723 22553 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:46265
I20260809 19:00:39.157768 22723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:46265 every 8 connection(s)
I20260809 19:00:39.158141 22553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
Aug 09 19:00:39 dist-test-slave-jq4t krb5kdc[22029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302039, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.3@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:00:39.165566 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 22553
I20260809 19:00:39.165652 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 19:00:39.165860 24468 external_mini_cluster.cc:1428] Setting key 23afa4b616a24c87a0f7a8831087d71d
I20260809 19:00:39.168459 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.158975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:43639 (local address 127.23.229.62:42927)
0809 19:00:39.159057 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.159059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.159267 (+ 208us) server_negotiation.cc:407] Connection header received
0809 19:00:39.159781 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.159782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.159801 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.159875 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:39.160999 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.161508 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.162508 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.162712 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.162780 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.165187 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:39.165189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:39.165190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:39.165197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:39.167089 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:39.167471 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:39.167472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:39.167472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:39.167527 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:39.167771 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:39.167772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:39.167772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:39.167933 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:39.167991 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.168298 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.168392 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:00:39.168627 22728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.158940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42927 (local address 127.23.229.3:43639)
0809 19:00:39.159141 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.159179 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.159688 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.159933 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.159936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.160703 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:39.160914 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.160920 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.161587 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.161587 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.162404 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.162406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.162815 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.162816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.162958 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.163540 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:39.163549 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:39.165083 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:39.167161 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:39.167167 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:39.167169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:39.167403 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:39.167570 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:39.167571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:39.167571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:39.167690 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:39.168004 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:39.168010 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:39.168143 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.168240 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.168377 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":116,"threads_started":1}
I20260809 19:00:39.169176 22724 heartbeater.cc:347] Connected to a master server at 127.23.229.62:42927
I20260809 19:00:39.169270 22724 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:39.169430 22724 heartbeater.cc:511] Master 127.23.229.62:42927 requested a full tablet report, sending...
I20260809 19:00:39.169761 22090 ts_manager.cc:194] Registered new tserver with Master: 9a96bf218f9d46879cdedd808628e3fd (127.23.229.3:46265)
I20260809 19:00:39.170164 22090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.229.3@KRBTEST.COM'} at 127.23.229.3:43639
I20260809 19:00:39.177994 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:39.185702 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.179492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52302 (local address 127.23.229.62:42927)
0809 19:00:39.179545 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.179546 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.179594 (+ 48us) server_negotiation.cc:407] Connection header received
0809 19:00:39.179649 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.179650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.179659 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.179714 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:39.180283 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.180884 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.181626 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.181821 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.181886 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.183080 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:39.183080 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:39.183081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:39.183086 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:39.184633 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:39.184927 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:39.184928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:39.184928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:39.184990 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:39.185160 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:39.185160 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:39.185161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:39.185379 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:39.185478 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.185573 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.185634 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 19:00:39.187305 22090 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:39.189031 22090 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:39.196015 22740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.191757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:45513 (local address 127.0.0.1:44388)
0809 19:00:39.192445 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.192456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.192531 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.192762 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.192763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.192765 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:39.192814 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.192816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.194048 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.194049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.194948 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.194951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.195655 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195655 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.195746 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.195761 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.195868 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.195929 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":1,"thread_start_us":72,"threads_started":1}
I20260809 19:00:39.196019 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.191902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44388 (local address 127.23.229.2:45513)
0809 19:00:39.192095 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.192101 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.192602 (+ 501us) server_negotiation.cc:407] Connection header received
0809 19:00:39.192650 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.192652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.192667 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.192744 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:39.192904 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.193940 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195042 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.195562 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195655 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.195723 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.195889 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.195932 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
I20260809 19:00:39.196347 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.191912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59036 (local address 127.23.229.3:46265)
0809 19:00:39.192132 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.192137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.192148 (+ 11us) server_negotiation.cc:407] Connection header received
0809 19:00:39.192194 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.192198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.192217 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.192326 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:39.192557 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.193724 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195067 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.195807 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195884 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.195941 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.196224 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.196275 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":91,"threads_started":1}
I20260809 19:00:39.196180 22741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.191517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:35927 (local address 127.0.0.1:42968)
0809 19:00:39.191678 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.191721 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.191815 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.192348 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.192349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.192350 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:39.192447 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.192450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.193568 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.193569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.194966 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.194968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.195916 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.195999 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.196004 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.196038 (+ 34us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.196089 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":51,"thread_start_us":68,"threads_started":1}
I20260809 19:00:39.196552 22742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.191651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42968 (local address 127.23.229.1:35927)
0809 19:00:39.192170 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.192174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.192185 (+ 11us) server_negotiation.cc:407] Connection header received
0809 19:00:39.192226 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.192228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.192246 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.192570 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:39.192654 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.193441 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195068 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.195807 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.196280 (+ 473us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.196357 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.196385 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.196439 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":93,"threads_started":1}
I20260809 19:00:39.196179 22743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.191525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:46265 (local address 127.0.0.1:59036)
0809 19:00:39.191887 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.191900 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.191955 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.192332 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.192336 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.192339 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:39.192447 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.192450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.193836 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.193837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.194956 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.194960 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.195971 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.195972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.196025 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.196029 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.196075 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.196110 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":9,"thread_start_us":97,"threads_started":1}
I20260809 19:00:39.197324 22275 tablet_service.cc:1467] Processing CreateTablet for tablet 2fcb2934ffb3410ab2f46119740ffcec (DEFAULT_TABLE table=test-table [id=5a606549a28943fba478e1e3cc4b6600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:39.197434 22632 tablet_service.cc:1467] Processing CreateTablet for tablet 2fcb2934ffb3410ab2f46119740ffcec (DEFAULT_TABLE table=test-table [id=5a606549a28943fba478e1e3cc4b6600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:39.197654 22275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fcb2934ffb3410ab2f46119740ffcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:39.197697 22632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fcb2934ffb3410ab2f46119740ffcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:39.200423 22746 tablet_bootstrap.cc:492] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Bootstrap starting.
I20260809 19:00:39.200429 22748 tablet_bootstrap.cc:492] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96: Bootstrap starting.
I20260809 19:00:39.201030 22454 tablet_service.cc:1467] Processing CreateTablet for tablet 2fcb2934ffb3410ab2f46119740ffcec (DEFAULT_TABLE table=test-table [id=5a606549a28943fba478e1e3cc4b6600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:39.201175 22748 tablet_bootstrap.cc:654] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:39.201184 22746 tablet_bootstrap.cc:654] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:39.201417 22454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fcb2934ffb3410ab2f46119740ffcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:39.201822 22748 log.cc:824] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:39.201828 22746 log.cc:824] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:39.202584 22748 tablet_bootstrap.cc:492] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96: No bootstrap required, opened a new log
I20260809 19:00:39.202625 22746 tablet_bootstrap.cc:492] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: No bootstrap required, opened a new log
I20260809 19:00:39.202672 22748 ts_tablet_manager.cc:1397] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:39.202687 22746 ts_tablet_manager.cc:1397] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:39.204432 22748 raft_consensus.cc:348] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.204689 22748 raft_consensus.cc:374] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:39.204761 22748 raft_consensus.cc:729] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ed2ea9d77e4b1c82417f095c463d96, State: Initialized, Role: FOLLOWER
I20260809 19:00:39.204815 22746 raft_consensus.cc:348] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.204923 22748 consensus_queue.cc:260] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.205009 22746 raft_consensus.cc:374] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:39.205050 22746 raft_consensus.cc:729] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a96bf218f9d46879cdedd808628e3fd, State: Initialized, Role: FOLLOWER
I20260809 19:00:39.205173 22746 consensus_queue.cc:260] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.205250 22748 ts_tablet_manager.cc:1428] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 19:00:39.205396 22753 tablet_bootstrap.cc:492] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Bootstrap starting.
I20260809 19:00:39.205417 22369 heartbeater.cc:503] Master 127.23.229.62:42927 was elected leader, sending a full tablet report...
I20260809 19:00:39.205859 22746 ts_tablet_manager.cc:1428] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 19:00:39.205994 22724 heartbeater.cc:503] Master 127.23.229.62:42927 was elected leader, sending a full tablet report...
I20260809 19:00:39.206023 22753 tablet_bootstrap.cc:654] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:39.206744 22753 log.cc:824] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:39.207636 22753 tablet_bootstrap.cc:492] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: No bootstrap required, opened a new log
I20260809 19:00:39.207719 22753 ts_tablet_manager.cc:1397] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:00:39.209254 22753 raft_consensus.cc:348] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.209424 22753 raft_consensus.cc:374] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:39.209448 22753 raft_consensus.cc:729] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b4b2abb3635451b9b8987272a9c1c42, State: Initialized, Role: FOLLOWER
I20260809 19:00:39.209578 22753 consensus_queue.cc:260] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.209872 22753 ts_tablet_manager.cc:1428] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 19:00:39.209924 22545 heartbeater.cc:503] Master 127.23.229.62:42927 was elected leader, sending a full tablet report...
W20260809 19:00:39.235601 22547 tablet.cc:2369] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:00:39.316043 22370 tablet.cc:2369] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:39.370456 22756 raft_consensus.cc:482] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:39.370606 22756 raft_consensus.cc:504] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.371083 22756 leader_election.cc:288] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28ed2ea9d77e4b1c82417f095c463d96 (127.23.229.1:35927), 9a96bf218f9d46879cdedd808628e3fd (127.23.229.3:46265)
I20260809 19:00:39.374531 22742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.371495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:60459 (local address 127.23.229.1:35927)
0809 19:00:39.371558 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.371561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.371571 (+ 10us) server_negotiation.cc:407] Connection header received
0809 19:00:39.371610 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.371611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.371623 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.371697 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:39.371883 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.372579 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.373741 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.374143 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.374236 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.374247 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.374411 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.374458 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 19:00:39.374539 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.371457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:52399 (local address 127.23.229.3:46265)
0809 19:00:39.371543 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.371546 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.371817 (+ 271us) server_negotiation.cc:407] Connection header received
0809 19:00:39.371850 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.371852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.371863 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.371927 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:39.372111 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.372664 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.373748 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.374160 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.374254 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.374264 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.374424 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.374467 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:00:39.374547 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.371333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:35927 (local address 127.23.229.2:60459)
0809 19:00:39.371401 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.371418 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.371499 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.371704 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.371705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.371707 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:39.371811 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.371814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.372670 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.372671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.373632 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.373635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.374234 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.374235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.374323 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.374331 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.374400 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.374447 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":3}
I20260809 19:00:39.374555 22758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.371333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:46265 (local address 127.23.229.2:52399)
0809 19:00:39.371731 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.371740 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.371800 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.371946 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.371946 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.371959 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:39.372033 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.372035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.372733 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.372735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.373644 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.373647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.374266 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.374267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.374345 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.374349 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.374416 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.374467 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":192,"thread_start_us":141,"threads_started":1}
I20260809 19:00:39.374965 22663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcb2934ffb3410ab2f46119740ffcec" candidate_uuid: "5b4b2abb3635451b9b8987272a9c1c42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a96bf218f9d46879cdedd808628e3fd" is_pre_election: true
I20260809 19:00:39.374966 22294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcb2934ffb3410ab2f46119740ffcec" candidate_uuid: "5b4b2abb3635451b9b8987272a9c1c42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28ed2ea9d77e4b1c82417f095c463d96" is_pre_election: true
I20260809 19:00:39.375146 22663 raft_consensus.cc:2454] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b4b2abb3635451b9b8987272a9c1c42 in term 0.
I20260809 19:00:39.375146 22294 raft_consensus.cc:2454] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b4b2abb3635451b9b8987272a9c1c42 in term 0.
I20260809 19:00:39.375407 22396 leader_election.cc:302] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b4b2abb3635451b9b8987272a9c1c42, 9a96bf218f9d46879cdedd808628e3fd; no voters:
I20260809 19:00:39.375620 22756 raft_consensus.cc:2781] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:39.375710 22756 raft_consensus.cc:482] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:39.375743 22756 raft_consensus.cc:3037] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:39.376528 22756 raft_consensus.cc:504] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.376695 22756 leader_election.cc:288] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [CANDIDATE]: Term 1 election: Requested vote from peers 28ed2ea9d77e4b1c82417f095c463d96 (127.23.229.1:35927), 9a96bf218f9d46879cdedd808628e3fd (127.23.229.3:46265)
I20260809 19:00:39.376847 22663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcb2934ffb3410ab2f46119740ffcec" candidate_uuid: "5b4b2abb3635451b9b8987272a9c1c42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a96bf218f9d46879cdedd808628e3fd"
I20260809 19:00:39.376878 22294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcb2934ffb3410ab2f46119740ffcec" candidate_uuid: "5b4b2abb3635451b9b8987272a9c1c42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28ed2ea9d77e4b1c82417f095c463d96"
I20260809 19:00:39.376956 22663 raft_consensus.cc:3037] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:39.376960 22294 raft_consensus.cc:3037] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:39.377701 22663 raft_consensus.cc:2454] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b4b2abb3635451b9b8987272a9c1c42 in term 1.
I20260809 19:00:39.377727 22294 raft_consensus.cc:2454] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b4b2abb3635451b9b8987272a9c1c42 in term 1.
I20260809 19:00:39.377903 22396 leader_election.cc:302] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b4b2abb3635451b9b8987272a9c1c42, 9a96bf218f9d46879cdedd808628e3fd; no voters:
I20260809 19:00:39.378001 22756 raft_consensus.cc:2781] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:39.378173 22756 raft_consensus.cc:686] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 1 LEADER]: Becoming Leader. State: Replica: 5b4b2abb3635451b9b8987272a9c1c42, State: Running, Role: LEADER
I20260809 19:00:39.378290 22756 consensus_queue.cc:237] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } }
I20260809 19:00:39.379287 22090 catalog_manager.cc:5495] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b4b2abb3635451b9b8987272a9c1c42 (127.23.229.2). New cstate: current_term: 1 leader_uuid: "5b4b2abb3635451b9b8987272a9c1c42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b4b2abb3635451b9b8987272a9c1c42" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 45513 } health_report { overall_health: HEALTHY } } }
W20260809 19:00:39.408766 22726 tablet.cc:2369] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:39.422322 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.420010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44394 (local address 127.23.229.2:45513)
0809 19:00:39.420084 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.420086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.420095 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:00:39.420137 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.420137 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.420157 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.420236 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:39.420366 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.420913 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.421654 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.421835 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.421885 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.422024 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:39.422128 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:39.422190 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.422224 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.422243 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 19:00:39.424280 22294 raft_consensus.cc:1261] T 2fcb2934ffb3410ab2f46119740ffcec P 28ed2ea9d77e4b1c82417f095c463d96 [term 1 FOLLOWER]: Refusing update from remote peer 5b4b2abb3635451b9b8987272a9c1c42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:39.424309 22663 raft_consensus.cc:1261] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 1 FOLLOWER]: Refusing update from remote peer 5b4b2abb3635451b9b8987272a9c1c42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:39.424690 22756 consensus_queue.cc:1035] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a96bf218f9d46879cdedd808628e3fd" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:39.424845 22760 consensus_queue.cc:1035] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28ed2ea9d77e4b1c82417f095c463d96" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 35927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:39.427143 22767 mvcc.cc:205] Tried to move back new op lower bound from 7316693153478647808 to 7316693153294159872. Current Snapshot: MvccSnapshot[applied={T|T < 7316693153478647808}]
I20260809 19:00:39.427714 22769 mvcc.cc:205] Tried to move back new op lower bound from 7316693153478647808 to 7316693153294159872. Current Snapshot: MvccSnapshot[applied={T|T < 7316693153478647808}]
I20260809 19:00:39.427912 22772 mvcc.cc:205] Tried to move back new op lower bound from 7316693153478647808 to 7316693153294159872. Current Snapshot: MvccSnapshot[applied={T|T < 7316693153478647808}]
I20260809 19:00:39.429661 22090 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:39.429765 22090 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:39.430596 22090 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 26b27555f61c4a079da240c4aa0c075e: Sending DeleteTablet for 3 replicas of tablet 2fcb2934ffb3410ab2f46119740ffcec
I20260809 19:00:39.430940 22275 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcb2934ffb3410ab2f46119740ffcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:39 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:42968
I20260809 19:00:39.430959 22632 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcb2934ffb3410ab2f46119740ffcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:39 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:59036
I20260809 19:00:39.431190 22454 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcb2934ffb3410ab2f46119740ffcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:39 UTC) from {username='kudu', principal='kudu/127.23.229.62@KRBTEST.COM'} at 127.0.0.1:44388
I20260809 19:00:39.431411 22783 tablet_replica.cc:330] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: stopping tablet replica
I20260809 19:00:39.431532 22783 raft_consensus.cc:2229] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:39.431533 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 22187
I20260809 19:00:39.431632 22783 raft_consensus.cc:2258] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:39.432093 22783 ts_tablet_manager.cc:1905] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:39.434998 22783 ts_tablet_manager.cc:1918] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:39.435081 22783 log.cc:1196] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/2fcb2934ffb3410ab2f46119740ffcec
I20260809 19:00:39.435376 22783 ts_tablet_manager.cc:1939] T 2fcb2934ffb3410ab2f46119740ffcec P 5b4b2abb3635451b9b8987272a9c1c42: Deleting consensus metadata
I20260809 19:00:39.435781 22071 catalog_manager.cc:4841] TS 5b4b2abb3635451b9b8987272a9c1c42 (127.23.229.2:45513): tablet 2fcb2934ffb3410ab2f46119740ffcec (table test-table [id=5a606549a28943fba478e1e3cc4b6600]) successfully deleted
I20260809 19:00:39.442343 22781 tablet_replica.cc:330] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: stopping tablet replica
I20260809 19:00:39.442520 22781 raft_consensus.cc:2229] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:39.442683 22781 raft_consensus.cc:2258] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:39.444299 22781 ts_tablet_manager.cc:1905] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:39.446672 22781 ts_tablet_manager.cc:1918] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:39.446768 22781 log.cc:1196] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/2fcb2934ffb3410ab2f46119740ffcec
I20260809 19:00:39.447172 22781 ts_tablet_manager.cc:1939] T 2fcb2934ffb3410ab2f46119740ffcec P 9a96bf218f9d46879cdedd808628e3fd: Deleting consensus metadata
I20260809 19:00:39.447795 22070 catalog_manager.cc:4841] TS 9a96bf218f9d46879cdedd808628e3fd (127.23.229.3:46265): tablet 2fcb2934ffb3410ab2f46119740ffcec (table test-table [id=5a606549a28943fba478e1e3cc4b6600]) successfully deleted
W20260809 19:00:39.454299 22071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:35927 (error 108)
I20260809 19:00:39.454500 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 22374
I20260809 19:00:39.456847 22740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.456663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:35927 (local address 127.0.0.1:42972)
0809 19:00:39.456733 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.456794 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:35927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:00:39.457031 22071 catalog_manager.cc:4584] TS 28ed2ea9d77e4b1c82417f095c463d96 (127.23.229.1:35927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2fcb2934ffb3410ab2f46119740ffcec: Network error: Client connection negotiation failed: client connection to 127.23.229.1:35927: connect: Connection refused (error 111)
I20260809 19:00:39.464349 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 22553
I20260809 19:00:39.476728 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 22046
2026-08-09T19:00:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2421 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T19:00:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:39Z Disabled control of system clock
I20260809 19:00:39.516750 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41827
--webserver_interface=127.23.229.62
--webserver_port=0
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:41827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:39.624109 22790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:39.624400 22790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:39.624441 22790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:39.625681 22790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:39.625756 22790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:39.625778 22790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:39.625802 22790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:39.625854 22790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:39.627274 22790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:41827
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:39.627580 22790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:39.627923 22790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:39.633134 22797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:39.633165 22796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:39.633155 22799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:39.633404 22790 server_base.cc:1034] running on GCE node
I20260809 19:00:39.633795 22790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:39.634102 22790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:39.635366 22790 hybrid_clock.cc:648] HybridClock initialized: now 1786302039635354 us; error 40 us; skew 500 ppm
I20260809 19:00:39.636777 22790 webserver.cc:460] Webserver started at http://127.23.229.62:40301/ using document root <none> and password file <none>
I20260809 19:00:39.637077 22790 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:39.637151 22790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:39.637311 22790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:39.638432 22790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "0ec21913e5c34fb3b8b96558c635db59"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "62b16ed55a9dd7b2705546ba854c7351"
server_key_iv: "51f3e1e15bafe0a0bb909e1a294f05bc"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.638821 22790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "0ec21913e5c34fb3b8b96558c635db59"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "62b16ed55a9dd7b2705546ba854c7351"
server_key_iv: "51f3e1e15bafe0a0bb909e1a294f05bc"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.640192 22790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:39.641057 22806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.641353 22790 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 19:00:39.641459 22790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "0ec21913e5c34fb3b8b96558c635db59"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "62b16ed55a9dd7b2705546ba854c7351"
server_key_iv: "51f3e1e15bafe0a0bb909e1a294f05bc"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.641537 22790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:39.652262 22790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:39.652679 22790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:39.652845 22790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:39.657094 22790 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:41827
I20260809 19:00:39.657163 22884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:41827 every 8 connection(s)
I20260809 19:00:39.657553 22790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:39.658639 22887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:39.659273 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 22790
I20260809 19:00:39.659384 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:39.659598 24468 external_mini_cluster.cc:1428] Setting key 489b44ff70b7fd985a7f6c90af66597b
I20260809 19:00:39.661645 22887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59: Bootstrap starting.
I20260809 19:00:39.662279 22887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:39.662571 22887 log.cc:824] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:39.663304 22887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59: No bootstrap required, opened a new log
I20260809 19:00:39.665385 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.660206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53326 (local address 127.23.229.62:41827)
0809 19:00:39.660435 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.660442 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.660469 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:00:39.660980 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.660988 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.661054 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.661217 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:39.661414 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.662415 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.663291 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.663804 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.663946 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.664727 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:39.664732 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:39.664732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:39.664921 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:39.664955 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:39.664965 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:39.665045 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.665124 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.665210 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":87,"threads_started":1}
I20260809 19:00:39.665248 22887 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec21913e5c34fb3b8b96558c635db59" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41827 } }
I20260809 19:00:39.665462 22887 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:39.665513 22887 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec21913e5c34fb3b8b96558c635db59, State: Initialized, Role: FOLLOWER
I20260809 19:00:39.665654 22887 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec21913e5c34fb3b8b96558c635db59" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41827 } }
I20260809 19:00:39.665766 22887 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:39.665815 22887 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:39.665868 22887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:39.666508 22887 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec21913e5c34fb3b8b96558c635db59" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41827 } }
I20260809 19:00:39.666642 22887 leader_election.cc:302] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ec21913e5c34fb3b8b96558c635db59; no voters:
I20260809 19:00:39.666846 22887 leader_election.cc:288] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:39.667033 22893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:39.667129 22887 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:39.667202 22893 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec21913e5c34fb3b8b96558c635db59, State: Running, Role: LEADER
I20260809 19:00:39.667302 22893 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec21913e5c34fb3b8b96558c635db59" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41827 } }
I20260809 19:00:39.667716 22894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ec21913e5c34fb3b8b96558c635db59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec21913e5c34fb3b8b96558c635db59" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41827 } } }
I20260809 19:00:39.667733 22895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ec21913e5c34fb3b8b96558c635db59. Latest consensus state: current_term: 1 leader_uuid: "0ec21913e5c34fb3b8b96558c635db59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec21913e5c34fb3b8b96558c635db59" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41827 } } }
I20260809 19:00:39.667832 22894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:39.667836 22895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:39.668080 22906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:39.668804 22906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:39.670344 22906 catalog_manager.cc:1347] Generated new cluster ID: e261edf6328c476c9641d4ec61dd8a77
I20260809 19:00:39.670399 22906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:39.676278 22906 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:39.676994 22906 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:39.681160 22906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59: Generated new TSK 0
I20260809 19:00:39.681346 22906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:39.683612 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.1:0
--local_ip_for_outbound_sockets=127.23.229.1
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41827
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:39.799628 22918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:39.799882 22918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:39.799922 22918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:39.801191 22918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:39.801257 22918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:39.801299 22918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.1
I20260809 19:00:39.802790 22918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.229.1
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.1
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:39.803076 22918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:39.803399 22918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:39.809554 22928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:39.809643 22926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:39.809562 22925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:39.809873 22918 server_base.cc:1034] running on GCE node
I20260809 19:00:39.810088 22918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:39.810354 22918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:39.811549 22918 hybrid_clock.cc:648] HybridClock initialized: now 1786302039811530 us; error 38 us; skew 500 ppm
I20260809 19:00:39.812994 22918 webserver.cc:460] Webserver started at http://127.23.229.1:42741/ using document root <none> and password file <none>
I20260809 19:00:39.813239 22918 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:39.813323 22918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:39.813496 22918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:39.814587 22918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data/instance:
uuid: "904479d3458948b695333affc787a5d9"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "75e9ad9a9f6f54a7205f66e70a4c65c9"
server_key_iv: "2a4cab71b980f263e627d6e7ac34aecd"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.814960 22918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance:
uuid: "904479d3458948b695333affc787a5d9"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "75e9ad9a9f6f54a7205f66e70a4c65c9"
server_key_iv: "2a4cab71b980f263e627d6e7ac34aecd"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.816398 22918 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:39.817288 22936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.817476 22918 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:39.817579 22918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/wal
uuid: "904479d3458948b695333affc787a5d9"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "75e9ad9a9f6f54a7205f66e70a4c65c9"
server_key_iv: "2a4cab71b980f263e627d6e7ac34aecd"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.817668 22918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:39.824077 22918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:39.824383 22918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:39.824571 22918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:39.824805 22918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:39.825140 22918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:39.825196 22918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.825238 22918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:39.825264 22918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.832053 22918 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.1:39019
I20260809 19:00:39.832103 23091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.1:39019 every 8 connection(s)
I20260809 19:00:39.832568 22918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:39.839115 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.833489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.1:53493 (local address 127.23.229.62:41827)
0809 19:00:39.833561 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.833564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.833862 (+ 298us) server_negotiation.cc:407] Connection header received
0809 19:00:39.834573 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.834574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.834586 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.834648 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:39.835620 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.836162 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.837536 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.837735 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.837787 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.838849 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:39.838850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:39.838850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:39.838855 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:39.838871 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:39.838875 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:39.838920 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.839015 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.839043 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 19:00:39.839366 23094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.833485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41827 (local address 127.23.229.1:53493)
0809 19:00:39.833705 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.833748 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.834448 (+ 700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.834724 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.834728 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.834739 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:39.835510 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.835517 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.836273 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.836275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.837431 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.837434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.837824 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.837825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.837999 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.838661 (+ 662us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:39.838661 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:39.838706 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:39.838738 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:39.838936 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:39.838942 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:39.838944 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.839009 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.839099 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260809 19:00:39.839926 23092 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41827
I20260809 19:00:39.840049 23092 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:39.840248 23092 heartbeater.cc:511] Master 127.23.229.62:41827 requested a full tablet report, sending...
I20260809 19:00:39.840832 22830 ts_manager.cc:194] Registered new tserver with Master: 904479d3458948b695333affc787a5d9 (127.23.229.1:39019)
I20260809 19:00:39.841435 22830 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.1:53493
I20260809 19:00:39.842525 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 22918
I20260809 19:00:39.842609 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-0/wal/instance
I20260809 19:00:39.842774 24468 external_mini_cluster.cc:1428] Setting key 5fc387b0b5457e8d0a754ccd20664fe3
I20260809 19:00:39.843683 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.2:0
--local_ip_for_outbound_sockets=127.23.229.2
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41827
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:00:39.931032 23096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:39.931264 23096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:39.931288 23096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:39.932418 23096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:39.932458 23096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:39.932519 23096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.2
I20260809 19:00:39.933861 23096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.229.2
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.2
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:39.934091 23096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:39.934365 23096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:39.939603 23105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:39.939612 23102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:39.939711 23103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:39.940006 23096 server_base.cc:1034] running on GCE node
I20260809 19:00:39.940250 23096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:39.940585 23096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:39.941757 23096 hybrid_clock.cc:648] HybridClock initialized: now 1786302039941735 us; error 42 us; skew 500 ppm
I20260809 19:00:39.943245 23096 webserver.cc:460] Webserver started at http://127.23.229.2:38411/ using document root <none> and password file <none>
I20260809 19:00:39.943552 23096 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:39.943630 23096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:39.943791 23096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:39.945025 23096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data/instance:
uuid: "72b218e50b314162afe888c4f0098d1f"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "be4bf1c48cf5a29b7ce3ace30c9f89bb"
server_key_iv: "2451fe00e9159e3bcb80d32c3efcf228"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.945415 23096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance:
uuid: "72b218e50b314162afe888c4f0098d1f"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "be4bf1c48cf5a29b7ce3ace30c9f89bb"
server_key_iv: "2451fe00e9159e3bcb80d32c3efcf228"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.946918 23096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 19:00:39.947768 23111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.948045 23096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:39.948158 23096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal
uuid: "72b218e50b314162afe888c4f0098d1f"
format_stamp: "Formatted at 2026-08-09 19:00:39 on dist-test-slave-jq4t"
server_key: "be4bf1c48cf5a29b7ce3ace30c9f89bb"
server_key_iv: "2451fe00e9159e3bcb80d32c3efcf228"
server_key_version: "encryptionkey@0"
I20260809 19:00:39.948238 23096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:39.956832 23096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:39.957167 23096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:39.957319 23096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:39.957547 23096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:39.957895 23096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:39.957949 23096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.957994 23096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:39.958032 23096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:39.963793 23096 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.2:36101
I20260809 19:00:39.963886 23271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.2:36101 every 8 connection(s)
I20260809 19:00:39.964259 23096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:39.970018 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 23096
I20260809 19:00:39.970155 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal/instance
I20260809 19:00:39.970183 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.965184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.2:55831 (local address 127.23.229.62:41827)
0809 19:00:39.965252 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:39.965254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:39.965523 (+ 269us) server_negotiation.cc:407] Connection header received
0809 19:00:39.966034 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:39.966035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:39.966046 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:39.966111 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:39.966821 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.967349 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.968521 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.968738 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.968830 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.969847 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:39.969849 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:39.969849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:39.969856 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:39.969875 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:39.969880 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:39.969935 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:39.970057 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 19:00:39.970098 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 19:00:39.970408 24468 external_mini_cluster.cc:1428] Setting key 9461dbeea6df88b156c986c926b5a391
I20260809 19:00:39.970422 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:39.965179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41827 (local address 127.23.229.2:55831)
0809 19:00:39.965380 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:39.965425 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:39.965937 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:39.966169 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:39.966172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:39.966180 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:39.966740 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.966745 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.967525 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.967531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.968395 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:39.968398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:39.968846 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:39.968847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:39.968987 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:39.969611 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:39.969612 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:39.969644 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:39.969670 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:39.969938 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:39.969946 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:39.969950 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:00:39.970058 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 19:00:39.970173 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260809 19:00:39.971035 23273 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41827
I20260809 19:00:39.971163 23273 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:39.971388 23273 heartbeater.cc:511] Master 127.23.229.62:41827 requested a full tablet report, sending...
I20260809 19:00:39.971621 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.229.3:0
--local_ip_for_outbound_sockets=127.23.229.3
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41827
--builtin_ntp_servers=127.23.229.20:42849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:00:39.971884 22830 ts_manager.cc:194] Registered new tserver with Master: 72b218e50b314162afe888c4f0098d1f (127.23.229.2:36101)
I20260809 19:00:39.972398 22830 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.2:55831
W20260809 19:00:40.057632 23277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:40.057914 23277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:40.057953 23277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:40.059151 23277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:40.059226 23277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:40.059267 23277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.229.3
I20260809 19:00:40.060726 23277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.229.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.229.3
--webserver_port=0
--tserver_master_addrs=127.23.229.62:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.229.3
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:40.061025 23277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:40.061360 23277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:40.066558 23284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:40.066663 23285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:40.066558 23288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:40.067055 23277 server_base.cc:1034] running on GCE node
I20260809 19:00:40.067305 23277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:40.067571 23277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:40.068739 23277 hybrid_clock.cc:648] HybridClock initialized: now 1786302040068718 us; error 34 us; skew 500 ppm
I20260809 19:00:40.070174 23277 webserver.cc:460] Webserver started at http://127.23.229.3:45771/ using document root <none> and password file <none>
I20260809 19:00:40.070480 23277 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:40.070554 23277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:40.070714 23277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:40.071833 23277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data/instance:
uuid: "2d05f5264abd4812ad58a57d53a50165"
format_stamp: "Formatted at 2026-08-09 19:00:40 on dist-test-slave-jq4t"
server_key: "b128a15bf2bce0354559ea31e33852dc"
server_key_iv: "93ecf8b062548b6cb09709584b0f1bb5"
server_key_version: "encryptionkey@0"
I20260809 19:00:40.072216 23277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance:
uuid: "2d05f5264abd4812ad58a57d53a50165"
format_stamp: "Formatted at 2026-08-09 19:00:40 on dist-test-slave-jq4t"
server_key: "b128a15bf2bce0354559ea31e33852dc"
server_key_iv: "93ecf8b062548b6cb09709584b0f1bb5"
server_key_version: "encryptionkey@0"
I20260809 19:00:40.073688 23277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:40.074461 23296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:40.074637 23277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:40.074744 23277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal
uuid: "2d05f5264abd4812ad58a57d53a50165"
format_stamp: "Formatted at 2026-08-09 19:00:40 on dist-test-slave-jq4t"
server_key: "b128a15bf2bce0354559ea31e33852dc"
server_key_iv: "93ecf8b062548b6cb09709584b0f1bb5"
server_key_version: "encryptionkey@0"
I20260809 19:00:40.074832 23277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:40.083509 23277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:40.083825 23277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:40.083982 23277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:40.084213 23277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:40.084636 23277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:40.084693 23277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:40.084729 23277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:40.084757 23277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:40.090775 23277 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.3:42101
I20260809 19:00:40.090829 23448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.3:42101 every 8 connection(s)
I20260809 19:00:40.091189 23277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/data/info.pb
I20260809 19:00:40.096930 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.092040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:43423 (local address 127.23.229.62:41827)
0809 19:00:40.092104 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.092105 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.092455 (+ 350us) server_negotiation.cc:407] Connection header received
0809 19:00:40.093040 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.093042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.093056 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.093124 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:40.093839 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.094359 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.095380 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.095586 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.095665 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.096621 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:40.096623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:40.096623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:40.096629 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:40.096649 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:40.096654 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:40.096714 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.096810 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.096841 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 19:00:40.097185 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.092020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:41827 (local address 127.23.229.3:43423)
0809 19:00:40.092230 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:40.092265 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:40.092919 (+ 654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:40.093199 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:40.093202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:40.093211 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:40.093733 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.093737 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.094456 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.094458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.095282 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.095284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.095674 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.095675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.095813 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.096407 (+ 594us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:00:40.096407 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:40.096440 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:00:40.096465 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:40.096715 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:40.096723 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:40.096726 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:40.096812 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 19:00:40.096926 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
I20260809 19:00:40.097756 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 23277
I20260809 19:00:40.097838 23449 heartbeater.cc:347] Connected to a master server at 127.23.229.62:41827
I20260809 19:00:40.097880 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal/instance
I20260809 19:00:40.097942 23449 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:40.098129 24468 external_mini_cluster.cc:1428] Setting key 9b028b71d896ca1f6f73c01bc91278f6
I20260809 19:00:40.098176 23449 heartbeater.cc:511] Master 127.23.229.62:41827 requested a full tablet report, sending...
I20260809 19:00:40.098588 22830 ts_manager.cc:194] Registered new tserver with Master: 2d05f5264abd4812ad58a57d53a50165 (127.23.229.3:42101)
I20260809 19:00:40.099100 24468 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:40.099120 22830 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.229.3:43423
I20260809 19:00:40.103708 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.100635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.23.229.62:41827)
0809 19:00:40.100674 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.100676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.100842 (+ 166us) server_negotiation.cc:407] Connection header received
0809 19:00:40.100918 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.100919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.100930 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.100985 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:40.101156 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.101679 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.102443 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.102653 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.102727 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.103449 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:40.103450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:40.103450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:40.103455 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:40.103469 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:40.103473 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:40.103528 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.103596 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.103618 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 19:00:40.105373 22830 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53328:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:40.107012 22830 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:40.114182 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.109365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:36101 (local address 127.0.0.1:34560)
0809 19:00:40.109593 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:40.109637 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:40.109722 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:40.110055 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:40.110058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:40.110060 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:40.110129 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.110131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.111472 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.111473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.112943 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.112946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.113839 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.113840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.113924 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.113939 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 19:00:40.114033 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 19:00:40.114096 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":73,"thread_start_us":76,"threads_started":1}
I20260809 19:00:40.114504 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.109461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34560 (local address 127.23.229.2:36101)
0809 19:00:40.109888 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.109893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.109903 (+ 10us) server_negotiation.cc:407] Connection header received
0809 19:00:40.109947 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.109949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.109961 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.110051 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:40.110222 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.111394 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.113040 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.113759 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.113817 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.113896 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.114067 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.114107 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":90,"threads_started":1}
I20260809 19:00:40.114806 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.109610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:39019 (local address 127.0.0.1:32874)
0809 19:00:40.109762 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:40.109773 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:40.109818 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:40.110351 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:40.110351 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:40.110352 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:40.110385 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.110386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.112580 (+ 2194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.112581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.113488 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.113490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.114575 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.114575 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.114638 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.114643 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:00:40.114696 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 19:00:40.114736 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260809 19:00:40.114836 23466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.109885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32874 (local address 127.23.229.1:39019)
0809 19:00:40.110130 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.110135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.110146 (+ 11us) server_negotiation.cc:407] Connection header received
0809 19:00:40.110187 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.110190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.110205 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.110283 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:40.111593 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.112452 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.113577 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.114254 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.114430 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.114539 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.114716 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.114758 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":120,"threads_started":1}
I20260809 19:00:40.115154 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.109412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.3:42101 (local address 127.0.0.1:53318)
0809 19:00:40.109659 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:40.109671 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:40.109729 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:40.110335 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:40.110336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:40.110338 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:40.110385 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.110389 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.111566 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.111567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.112943 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.112946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.114904 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.114905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.114975 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.114980 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:00:40.115042 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 19:00:40.115091 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":69,"thread_start_us":100,"threads_started":1}
I20260809 19:00:40.115455 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.109500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53318 (local address 127.23.229.3:42101)
0809 19:00:40.110184 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.110188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.110199 (+ 11us) server_negotiation.cc:407] Connection header received
0809 19:00:40.110238 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.110240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.110256 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.110336 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:40.110445 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.111497 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.113930 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.114687 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.114759 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.114855 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.115330 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.115374 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":81,"threads_started":1}
I20260809 19:00:40.115459 23003 tablet_service.cc:1467] Processing CreateTablet for tablet f663ac578c464adda28ae6cf9fe9d0cc (DEFAULT_TABLE table=test-table [id=e8ccf571419442a98f0e5a5e2718ab82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:40.115454 23176 tablet_service.cc:1467] Processing CreateTablet for tablet f663ac578c464adda28ae6cf9fe9d0cc (DEFAULT_TABLE table=test-table [id=e8ccf571419442a98f0e5a5e2718ab82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:40.115873 23176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f663ac578c464adda28ae6cf9fe9d0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:40.115873 23003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f663ac578c464adda28ae6cf9fe9d0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:40.116161 23361 tablet_service.cc:1467] Processing CreateTablet for tablet f663ac578c464adda28ae6cf9fe9d0cc (DEFAULT_TABLE table=test-table [id=e8ccf571419442a98f0e5a5e2718ab82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:40.116415 23361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f663ac578c464adda28ae6cf9fe9d0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:40.119124 23467 tablet_bootstrap.cc:492] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Bootstrap starting.
I20260809 19:00:40.119495 23470 tablet_bootstrap.cc:492] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9: Bootstrap starting.
I20260809 19:00:40.120050 23467 tablet_bootstrap.cc:654] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:40.120177 23470 tablet_bootstrap.cc:654] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:40.120411 23467 log.cc:824] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:40.120512 23470 log.cc:824] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:40.120764 23469 tablet_bootstrap.cc:492] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Bootstrap starting.
I20260809 19:00:40.121434 23469 tablet_bootstrap.cc:654] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:40.121456 23470 tablet_bootstrap.cc:492] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9: No bootstrap required, opened a new log
I20260809 19:00:40.121528 23470 ts_tablet_manager.cc:1397] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:00:40.121547 23467 tablet_bootstrap.cc:492] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: No bootstrap required, opened a new log
I20260809 19:00:40.121603 23467 ts_tablet_manager.cc:1397] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 19:00:40.121764 23469 log.cc:824] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:40.122481 23469 tablet_bootstrap.cc:492] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: No bootstrap required, opened a new log
I20260809 19:00:40.122557 23469 ts_tablet_manager.cc:1397] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:00:40.124202 23470 raft_consensus.cc:348] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.124163 23467 raft_consensus.cc:348] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.124348 23470 raft_consensus.cc:374] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:40.124348 23467 raft_consensus.cc:374] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:40.124385 23470 raft_consensus.cc:729] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904479d3458948b695333affc787a5d9, State: Initialized, Role: FOLLOWER
I20260809 19:00:40.124399 23467 raft_consensus.cc:729] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d05f5264abd4812ad58a57d53a50165, State: Initialized, Role: FOLLOWER
I20260809 19:00:40.124382 23469 raft_consensus.cc:348] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.124563 23467 consensus_queue.cc:260] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.124549 23470 consensus_queue.cc:260] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.124636 23469 raft_consensus.cc:374] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:40.124688 23469 raft_consensus.cc:729] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b218e50b314162afe888c4f0098d1f, State: Initialized, Role: FOLLOWER
I20260809 19:00:40.124825 23467 ts_tablet_manager.cc:1428] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 19:00:40.124826 23470 ts_tablet_manager.cc:1428] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 19:00:40.124825 23469 consensus_queue.cc:260] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.124953 23449 heartbeater.cc:503] Master 127.23.229.62:41827 was elected leader, sending a full tablet report...
I20260809 19:00:40.125147 23273 heartbeater.cc:503] Master 127.23.229.62:41827 was elected leader, sending a full tablet report...
I20260809 19:00:40.125401 23092 heartbeater.cc:503] Master 127.23.229.62:41827 was elected leader, sending a full tablet report...
I20260809 19:00:40.125136 23469 ts_tablet_manager.cc:1428] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260809 19:00:40.214991 23275 tablet.cc:2369] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:00:40.333362 23093 tablet.cc:2369] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:00:40.341837 23450 tablet.cc:2369] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:40.506755 23476 raft_consensus.cc:482] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:40.506889 23476 raft_consensus.cc:504] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.507222 23476 leader_election.cc:288] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72b218e50b314162afe888c4f0098d1f (127.23.229.2:36101), 904479d3458948b695333affc787a5d9 (127.23.229.1:39019)
I20260809 19:00:40.510226 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.507555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:47159 (local address 127.23.229.2:36101)
0809 19:00:40.507629 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.507631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.507645 (+ 14us) server_negotiation.cc:407] Connection header received
0809 19:00:40.507689 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.507690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.507702 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.507762 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:40.507955 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.508460 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.509506 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.509870 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.509956 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.509966 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.510114 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.510151 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:00:40.510226 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.507450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.2:36101 (local address 127.23.229.3:47159)
0809 19:00:40.507525 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:40.507539 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:40.507630 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:40.507780 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:40.507781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:40.507783 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:40.507868 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.507870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.508587 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.508588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.509405 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.509408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.509955 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.509956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.510034 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.510037 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 19:00:40.510106 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 19:00:40.510149 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":28}
I20260809 19:00:40.510311 23466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.507684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.229.3:46709 (local address 127.23.229.1:39019)
0809 19:00:40.507734 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.507736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.507808 (+ 72us) server_negotiation.cc:407] Connection header received
0809 19:00:40.507870 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.507871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.507882 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.507957 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:40.508129 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.508651 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.509581 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.509931 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.510029 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.510037 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.510186 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.510223 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 19:00:40.510372 23480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.507582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:39019 (local address 127.23.229.3:46709)
0809 19:00:40.507750 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:40.507764 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:40.507810 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:40.507960 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:40.507961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:40.507962 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:40.508041 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.508043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.508731 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.508732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.509479 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:40.509481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.510032 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.510033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:40.510108 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.510116 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:00:40.510181 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 19:00:40.510219 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":2,"thread_start_us":115,"threads_started":1}
I20260809 19:00:40.510630 23208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f663ac578c464adda28ae6cf9fe9d0cc" candidate_uuid: "2d05f5264abd4812ad58a57d53a50165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b218e50b314162afe888c4f0098d1f" is_pre_election: true
I20260809 19:00:40.510761 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f663ac578c464adda28ae6cf9fe9d0cc" candidate_uuid: "2d05f5264abd4812ad58a57d53a50165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904479d3458948b695333affc787a5d9" is_pre_election: true
I20260809 19:00:40.510847 23208 raft_consensus.cc:2454] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d05f5264abd4812ad58a57d53a50165 in term 0.
I20260809 19:00:40.510944 23030 raft_consensus.cc:2454] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d05f5264abd4812ad58a57d53a50165 in term 0.
I20260809 19:00:40.511143 23302 leader_election.cc:302] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d05f5264abd4812ad58a57d53a50165, 72b218e50b314162afe888c4f0098d1f; no voters:
I20260809 19:00:40.511315 23476 raft_consensus.cc:2781] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:40.511390 23476 raft_consensus.cc:482] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:40.511409 23476 raft_consensus.cc:3037] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:40.512156 23476 raft_consensus.cc:504] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.512305 23476 leader_election.cc:288] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [CANDIDATE]: Term 1 election: Requested vote from peers 72b218e50b314162afe888c4f0098d1f (127.23.229.2:36101), 904479d3458948b695333affc787a5d9 (127.23.229.1:39019)
I20260809 19:00:40.512494 23208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f663ac578c464adda28ae6cf9fe9d0cc" candidate_uuid: "2d05f5264abd4812ad58a57d53a50165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b218e50b314162afe888c4f0098d1f"
I20260809 19:00:40.512511 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f663ac578c464adda28ae6cf9fe9d0cc" candidate_uuid: "2d05f5264abd4812ad58a57d53a50165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904479d3458948b695333affc787a5d9"
I20260809 19:00:40.512579 23030 raft_consensus.cc:3037] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:40.512579 23208 raft_consensus.cc:3037] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:40.513484 23208 raft_consensus.cc:2454] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d05f5264abd4812ad58a57d53a50165 in term 1.
I20260809 19:00:40.513484 23030 raft_consensus.cc:2454] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d05f5264abd4812ad58a57d53a50165 in term 1.
I20260809 19:00:40.513655 23302 leader_election.cc:302] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d05f5264abd4812ad58a57d53a50165, 72b218e50b314162afe888c4f0098d1f; no voters:
I20260809 19:00:40.513764 23476 raft_consensus.cc:2781] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:40.513947 23476 raft_consensus.cc:686] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 1 LEADER]: Becoming Leader. State: Replica: 2d05f5264abd4812ad58a57d53a50165, State: Running, Role: LEADER
I20260809 19:00:40.514045 23476 consensus_queue.cc:237] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } }
I20260809 19:00:40.514968 22830 catalog_manager.cc:5495] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d05f5264abd4812ad58a57d53a50165 (127.23.229.3). New cstate: current_term: 1 leader_uuid: "2d05f5264abd4812ad58a57d53a50165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d05f5264abd4812ad58a57d53a50165" member_type: VOTER last_known_addr { host: "127.23.229.3" port: 42101 } health_report { overall_health: HEALTHY } } }
I20260809 19:00:40.555114 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.552747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53326 (local address 127.23.229.3:42101)
0809 19:00:40.552822 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:40.552824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:40.552832 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:00:40.552873 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:40.552873 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:40.552894 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:40.552961 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:40.553075 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.553555 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.554323 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:40.554527 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:40.554595 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:40.554727 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:40.554840 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:40.554905 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:40.554937 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 19:00:40.554954 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:00:40.557395 23030 raft_consensus.cc:1261] T f663ac578c464adda28ae6cf9fe9d0cc P 904479d3458948b695333affc787a5d9 [term 1 FOLLOWER]: Refusing update from remote peer 2d05f5264abd4812ad58a57d53a50165: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:40.557395 23208 raft_consensus.cc:1261] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 1 FOLLOWER]: Refusing update from remote peer 2d05f5264abd4812ad58a57d53a50165: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:40.557821 23476 consensus_queue.cc:1035] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b218e50b314162afe888c4f0098d1f" member_type: VOTER last_known_addr { host: "127.23.229.2" port: 36101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:40.557993 23481 consensus_queue.cc:1035] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904479d3458948b695333affc787a5d9" member_type: VOTER last_known_addr { host: "127.23.229.1" port: 39019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:40.560778 23491 mvcc.cc:205] Tried to move back new op lower bound from 7316693158119026688 to 7316693157946044416. Current Snapshot: MvccSnapshot[applied={T|T < 7316693158119026688}]
I20260809 19:00:40.563452 22825 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:40.563572 22825 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:40.564457 22825 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ec21913e5c34fb3b8b96558c635db59: Sending DeleteTablet for 3 replicas of tablet f663ac578c464adda28ae6cf9fe9d0cc
I20260809 19:00:40.564848 23176 tablet_service.cc:1514] Processing DeleteTablet for tablet f663ac578c464adda28ae6cf9fe9d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:40 UTC) from {username='slave'} at 127.0.0.1:34560
I20260809 19:00:40.564909 23003 tablet_service.cc:1514] Processing DeleteTablet for tablet f663ac578c464adda28ae6cf9fe9d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:40 UTC) from {username='slave'} at 127.0.0.1:32874
I20260809 19:00:40.565158 23361 tablet_service.cc:1514] Processing DeleteTablet for tablet f663ac578c464adda28ae6cf9fe9d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:40 UTC) from {username='slave'} at 127.0.0.1:53318
I20260809 19:00:40.565268 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 22918
I20260809 19:00:40.565377 23507 tablet_replica.cc:330] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: stopping tablet replica
I20260809 19:00:40.565510 23507 raft_consensus.cc:2229] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:40.565706 23507 raft_consensus.cc:2258] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:40.570642 23507 ts_tablet_manager.cc:1905] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:40.572949 23507 ts_tablet_manager.cc:1918] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:40.573072 23507 log.cc:1196] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-2/wal/wals/f663ac578c464adda28ae6cf9fe9d0cc
I20260809 19:00:40.573370 23507 ts_tablet_manager.cc:1939] T f663ac578c464adda28ae6cf9fe9d0cc P 2d05f5264abd4812ad58a57d53a50165: Deleting consensus metadata
I20260809 19:00:40.573844 22807 catalog_manager.cc:4841] TS 2d05f5264abd4812ad58a57d53a50165 (127.23.229.3:42101): tablet f663ac578c464adda28ae6cf9fe9d0cc (table test-table [id=e8ccf571419442a98f0e5a5e2718ab82]) successfully deleted
I20260809 19:00:40.576603 23504 tablet_replica.cc:330] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: stopping tablet replica
I20260809 19:00:40.576763 23504 raft_consensus.cc:2229] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:40.576921 23504 raft_consensus.cc:2258] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:40.577472 23504 ts_tablet_manager.cc:1905] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:40.579136 23504 ts_tablet_manager.cc:1918] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:40.579226 23504 log.cc:1196] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Deleting WAL directory at /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301787754163-24468-0/minicluster-data/ts-1/wal/wals/f663ac578c464adda28ae6cf9fe9d0cc
I20260809 19:00:40.579485 23504 ts_tablet_manager.cc:1939] T f663ac578c464adda28ae6cf9fe9d0cc P 72b218e50b314162afe888c4f0098d1f: Deleting consensus metadata
I20260809 19:00:40.580003 22811 catalog_manager.cc:4841] TS 72b218e50b314162afe888c4f0098d1f (127.23.229.2:36101): tablet f663ac578c464adda28ae6cf9fe9d0cc (table test-table [id=e8ccf571419442a98f0e5a5e2718ab82]) successfully deleted
W20260809 19:00:40.581939 22811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.229.1:39019 (error 108)
I20260809 19:00:40.582338 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 23096
I20260809 19:00:40.582477 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:40.582325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.1:39019 (local address 127.0.0.1:32876)
0809 19:00:40.582384 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:40.582434 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.1:39019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 19:00:40.596040 22811 catalog_manager.cc:4584] TS 904479d3458948b695333affc787a5d9 (127.23.229.1:39019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f663ac578c464adda28ae6cf9fe9d0cc: Network error: Client connection negotiation failed: client connection to 127.23.229.1:39019: connect: Connection refused (error 111)
I20260809 19:00:40.606498 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 23277
I20260809 19:00:40.615622 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 22790
2026-08-09T19:00:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1139 ms)
[----------] 6 tests from EncryptionPolicyTest (9741 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:40 dist-test-slave-jq4t krb5kdc[23513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:40 dist-test-slave-jq4t krb5kdc[23513](info): set up 2 sockets
Aug 09 19:00:40 dist-test-slave-jq4t krb5kdc[23513](info): commencing operation
krb5kdc: starting...
W20260809 19:00:41.866609 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:41 dist-test-slave-jq4t krb5kdc[23513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:41.994982 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44655
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:42.081317 23527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:42.081534 23527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:42.081558 23527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:42.082754 23527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:42.082803 23527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:42.082818 23527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:42.082832 23527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:42.082845 23527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:42.084386 23527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44655
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:42.084683 23527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:42.084944 23527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:42.090067 23537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:42.090065 23533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:42.090139 23527 server_base.cc:1034] running on GCE node
W20260809 19:00:42.090104 23534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:42.090579 23527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:42.090909 23527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:42.092119 23527 hybrid_clock.cc:648] HybridClock initialized: now 1786302042092101 us; error 49 us; skew 500 ppm
Aug 09 19:00:42 dist-test-slave-jq4t krb5kdc[23513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302042, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:42.094751 23527 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:42.095206 23527 webserver.cc:460] Webserver started at http://127.0.0.1:41097/ using document root <none> and password file <none>
I20260809 19:00:42.095481 23527 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:42.095554 23527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:42.095708 23527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:42.096887 23527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "a854d04e821b47cf93b301a8ef728213"
format_stamp: "Formatted at 2026-08-09 19:00:42 on dist-test-slave-jq4t"
server_key: "6125de792e0867226b79ac01e055d0f1"
server_key_iv: "8cb673e1a41071d8d25286a90a1c0b11"
server_key_version: "encryptionkey@0"
I20260809 19:00:42.097259 23527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "a854d04e821b47cf93b301a8ef728213"
format_stamp: "Formatted at 2026-08-09 19:00:42 on dist-test-slave-jq4t"
server_key: "6125de792e0867226b79ac01e055d0f1"
server_key_iv: "8cb673e1a41071d8d25286a90a1c0b11"
server_key_version: "encryptionkey@0"
I20260809 19:00:42.098623 23527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 19:00:42.099360 23547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:42.099545 23527 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:42.099639 23527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "a854d04e821b47cf93b301a8ef728213"
format_stamp: "Formatted at 2026-08-09 19:00:42 on dist-test-slave-jq4t"
server_key: "6125de792e0867226b79ac01e055d0f1"
server_key_iv: "8cb673e1a41071d8d25286a90a1c0b11"
server_key_version: "encryptionkey@0"
I20260809 19:00:42.099722 23527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:42.112249 23527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:42.114421 23527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:42.114611 23527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:42.118824 23527 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44655
I20260809 19:00:42.118897 23616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44655 every 8 connection(s)
I20260809 19:00:42.119279 23527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:42.120285 23617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:42.120798 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 23527
I20260809 19:00:42.120929 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:42.121145 24468 external_mini_cluster.cc:1428] Setting key 4b0ff45304224d084153862bca7ffadb
I20260809 19:00:42.123606 23617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213: Bootstrap starting.
I20260809 19:00:42.124259 23617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:42.124635 23617 log.cc:824] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:42.125447 23617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213: No bootstrap required, opened a new log
I20260809 19:00:42.128062 23617 raft_consensus.cc:348] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a854d04e821b47cf93b301a8ef728213" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44655 } }
I20260809 19:00:42.128203 23617 raft_consensus.cc:374] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:42.128226 23617 raft_consensus.cc:729] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a854d04e821b47cf93b301a8ef728213, State: Initialized, Role: FOLLOWER
I20260809 19:00:42.128371 23617 consensus_queue.cc:260] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a854d04e821b47cf93b301a8ef728213" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44655 } }
I20260809 19:00:42.128450 23617 raft_consensus.cc:388] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
Aug 09 19:00:42 dist-test-slave-jq4t krb5kdc[23513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:00:42.128513 23617 raft_consensus.cc:482] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:42.128573 23617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:42.129133 23617 raft_consensus.cc:504] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a854d04e821b47cf93b301a8ef728213" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44655 } }
I20260809 19:00:42.129261 23617 leader_election.cc:302] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a854d04e821b47cf93b301a8ef728213; no voters:
I20260809 19:00:42.129464 23617 leader_election.cc:288] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:42.129534 23623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:42.129688 23623 raft_consensus.cc:686] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [term 1 LEADER]: Becoming Leader. State: Replica: a854d04e821b47cf93b301a8ef728213, State: Running, Role: LEADER
I20260809 19:00:42.129853 23623 consensus_queue.cc:237] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a854d04e821b47cf93b301a8ef728213" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44655 } }
I20260809 19:00:42.129863 23617 sys_catalog.cc:564] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:42.130295 23624 sys_catalog.cc:455] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a854d04e821b47cf93b301a8ef728213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a854d04e821b47cf93b301a8ef728213" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44655 } } }
I20260809 19:00:42.130565 23624 sys_catalog.cc:458] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:42.130486 23625 sys_catalog.cc:455] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a854d04e821b47cf93b301a8ef728213. Latest consensus state: current_term: 1 leader_uuid: "a854d04e821b47cf93b301a8ef728213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a854d04e821b47cf93b301a8ef728213" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44655 } } }
I20260809 19:00:42.131031 23625 sys_catalog.cc:458] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:42.131034 23629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:42.131649 23629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:42.132972 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:42.121743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39899 (local address 127.0.0.1:44655)
0809 19:00:42.121925 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:42.121934 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:42.121962 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:00:42.122438 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:42.122446 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:42.122502 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:42.122620 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:42.123468 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:42.124434 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:42.125565 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:42.126017 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:42.126099 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:42.129047 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:42.129051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:42.129052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:42.129065 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:42.131239 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:42.131711 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:42.131714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:42.131715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:42.131829 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:42.132102 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:42.132103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:42.132104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:42.132347 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:42.132556 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:42.132646 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 19:00:42.132752 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260809 19:00:42.133422 23629 catalog_manager.cc:1347] Generated new cluster ID: 103aa3cbddf1471c9e5ce2bd16f09e20
I20260809 19:00:42.133469 23629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:42.137224 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:42.146499 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:42.138785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33629 (local address 127.0.0.1:44655)
0809 19:00:42.138829 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:42.138830 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:42.138889 (+ 59us) server_negotiation.cc:407] Connection header received
0809 19:00:42.138941 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:42.138942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:42.138953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:42.139005 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:42.139614 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:42.140442 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:42.141438 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:42.141797 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:42.141883 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:42.143323 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:42.143325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:42.143325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:42.143333 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:42.145080 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:42.145530 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:42.145531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:42.145532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:42.145598 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:42.145827 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:42.145827 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:42.145828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:42.145977 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:42.146098 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:42.146203 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 19:00:42.146275 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 19:00:42.155303 23629 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:42.155869 23629 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:42.159570 23629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a854d04e821b47cf93b301a8ef728213: Generated new TSK 0
I20260809 19:00:42.159787 23629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:42.166254 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 23527
W20260809 19:00:42.180591 23510 connection.cc:535] client connection to 127.0.0.1:44655 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44655): Connection reset by peer (error 104)
2026-08-09T19:00:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1554 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:42 dist-test-slave-jq4t krb5kdc[23655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:42 dist-test-slave-jq4t krb5kdc[23655](info): set up 2 sockets
Aug 09 19:00:42 dist-test-slave-jq4t krb5kdc[23655](info): commencing operation
krb5kdc: starting...
W20260809 19:00:43.407208 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:43 dist-test-slave-jq4t krb5kdc[23655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:43.533656 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36951
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:43.618551 23673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:43.618775 23673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:43.618798 23673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:43.619998 23673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:43.620046 23673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:43.620060 23673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:43.620074 23673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:43.620085 23673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:43.621661 23673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36951
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:43.621951 23673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:43.622203 23673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:43.627322 23679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:43.627318 23682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:43.627359 23680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:43.627661 23673 server_base.cc:1034] running on GCE node
I20260809 19:00:43.627930 23673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:43.628190 23673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:43.629376 23673 hybrid_clock.cc:648] HybridClock initialized: now 1786302043629363 us; error 32 us; skew 500 ppm
Aug 09 19:00:43 dist-test-slave-jq4t krb5kdc[23655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302043, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:43.637054 23673 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:43.637575 23673 webserver.cc:460] Webserver started at http://127.0.0.1:38153/ using document root <none> and password file <none>
I20260809 19:00:43.637823 23673 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:43.637869 23673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:43.638028 23673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:43.639155 23673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "ccdc52d4e4584e05b97cb9d10bda1400"
format_stamp: "Formatted at 2026-08-09 19:00:43 on dist-test-slave-jq4t"
server_key: "89fde835f35fa654a1338d2c73bf4682"
server_key_iv: "285da73b763431a087ee3206d29c3a24"
server_key_version: "encryptionkey@0"
I20260809 19:00:43.639533 23673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "ccdc52d4e4584e05b97cb9d10bda1400"
format_stamp: "Formatted at 2026-08-09 19:00:43 on dist-test-slave-jq4t"
server_key: "89fde835f35fa654a1338d2c73bf4682"
server_key_iv: "285da73b763431a087ee3206d29c3a24"
server_key_version: "encryptionkey@0"
I20260809 19:00:43.641084 23673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:00:43.641939 23693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:43.642127 23673 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:00:43.642246 23673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "ccdc52d4e4584e05b97cb9d10bda1400"
format_stamp: "Formatted at 2026-08-09 19:00:43 on dist-test-slave-jq4t"
server_key: "89fde835f35fa654a1338d2c73bf4682"
server_key_iv: "285da73b763431a087ee3206d29c3a24"
server_key_version: "encryptionkey@0"
I20260809 19:00:43.642330 23673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:43.649829 23673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:43.652087 23673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:43.652268 23673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:43.656592 23673 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36951
I20260809 19:00:43.656649 23762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36951 every 8 connection(s)
I20260809 19:00:43.657058 23673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:43.657999 23763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:43.659510 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 23673
I20260809 19:00:43.659603 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:43.659813 24468 external_mini_cluster.cc:1428] Setting key a3d7c21fd9758c7e8b19a70659956ca8
I20260809 19:00:43.660885 23763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400: Bootstrap starting.
I20260809 19:00:43.661634 23763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:43.661947 23763 log.cc:824] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:43.662726 23763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400: No bootstrap required, opened a new log
I20260809 19:00:43.665213 23763 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260809 19:00:43.665385 23763 raft_consensus.cc:374] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:43.665436 23763 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccdc52d4e4584e05b97cb9d10bda1400, State: Initialized, Role: FOLLOWER
I20260809 19:00:43.665589 23763 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260809 19:00:43.665688 23763 raft_consensus.cc:388] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:43.665714 23763 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:43.665788 23763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:43.665794 23770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:43.660368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41269 (local address 127.0.0.1:36951)
0809 19:00:43.660575 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:43.660583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:43.660609 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:00:43.661071 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:43.661078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:43.661127 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:43.661242 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:43.661494 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:43.662656 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:43.663754 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:43.664178 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:43.664260 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:43.665069 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:43.665073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:43.665073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:43.665241 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:43.665271 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:43.665282 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:43.665348 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:43.665552 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 19:00:43.665590 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260809 19:00:43.666567 23763 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260809 19:00:43.666687 23763 leader_election.cc:302] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccdc52d4e4584e05b97cb9d10bda1400; no voters:
I20260809 19:00:43.666859 23763 leader_election.cc:288] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:43.666884 23772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:43.666889 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:43.667066 23772 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [term 1 LEADER]: Becoming Leader. State: Replica: ccdc52d4e4584e05b97cb9d10bda1400, State: Running, Role: LEADER
I20260809 19:00:43.667171 23763 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:43.667218 23772 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260809 19:00:43.667631 23775 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccdc52d4e4584e05b97cb9d10bda1400. Latest consensus state: current_term: 1 leader_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } } }
I20260809 19:00:43.667644 23774 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccdc52d4e4584e05b97cb9d10bda1400" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } } }
I20260809 19:00:43.667815 23775 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:43.667829 23774 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:43.668138 23785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:43.668820 23785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:43.670653 23785 catalog_manager.cc:1347] Generated new cluster ID: 8b8e4d936df74b849924705c1d2eda71
I20260809 19:00:43.670702 23785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:43.672425 23770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:43.669049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58781 (local address 127.0.0.1:36951)
0809 19:00:43.669098 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:43.669100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:43.669385 (+ 285us) server_negotiation.cc:407] Connection header received
0809 19:00:43.669467 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:43.669468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:43.669478 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:43.669523 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:43.669673 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:43.670357 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:43.671081 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:43.671309 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:43.671399 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:43.672150 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:43.672152 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:43.672152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:43.672157 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:43.672173 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:43.672177 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:43.672257 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:43.672321 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 19:00:43.672331 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 19:00:43.704846 23785 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:43.705468 23785 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:43.708040 23785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ccdc52d4e4584e05b97cb9d10bda1400: Generated new TSK 0
I20260809 19:00:43.708262 23785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:43.716570 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 23673
W20260809 19:00:43.731809 23653 connection.cc:535] client connection to 127.0.0.1:36951 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36951): Connection reset by peer (error 104)
2026-08-09T19:00:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1551 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:43 dist-test-slave-jq4t krb5kdc[23809](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:43 dist-test-slave-jq4t krb5kdc[23809](info): set up 2 sockets
Aug 09 19:00:43 dist-test-slave-jq4t krb5kdc[23809](info): commencing operation
krb5kdc: starting...
W20260809 19:00:44.969627 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:45 dist-test-slave-jq4t krb5kdc[23809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:45.101460 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36933
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:45.189185 23829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:45.189466 23829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:45.189514 23829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:45.190735 23829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:45.190840 23829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:45.190867 23829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:45.190900 23829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:45.190933 23829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:45.192605 23829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36933
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:45.192924 23829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:45.193185 23829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:45.198405 23835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:45.198405 23842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:45.198421 23838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:45.198764 23829 server_base.cc:1034] running on GCE node
I20260809 19:00:45.199055 23829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:45.199409 23829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:45.200546 23829 hybrid_clock.cc:648] HybridClock initialized: now 1786302045200531 us; error 38 us; skew 500 ppm
Aug 09 19:00:45 dist-test-slave-jq4t krb5kdc[23809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302045, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:45.203153 23829 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:45.203627 23829 webserver.cc:460] Webserver started at http://127.0.0.1:45209/ using document root <none> and password file <none>
I20260809 19:00:45.203888 23829 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:45.203961 23829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:45.204130 23829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:45.205356 23829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "e9effa985fe74133a66bd6df37ea5a92"
format_stamp: "Formatted at 2026-08-09 19:00:45 on dist-test-slave-jq4t"
server_key: "875d78d7c4104b797751540cf6508b92"
server_key_iv: "76754357901c95090868cfeb8941d506"
server_key_version: "encryptionkey@0"
I20260809 19:00:45.205758 23829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "e9effa985fe74133a66bd6df37ea5a92"
format_stamp: "Formatted at 2026-08-09 19:00:45 on dist-test-slave-jq4t"
server_key: "875d78d7c4104b797751540cf6508b92"
server_key_iv: "76754357901c95090868cfeb8941d506"
server_key_version: "encryptionkey@0"
I20260809 19:00:45.207268 23829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 19:00:45.208083 23850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:45.208315 23829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:00:45.208441 23829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "e9effa985fe74133a66bd6df37ea5a92"
format_stamp: "Formatted at 2026-08-09 19:00:45 on dist-test-slave-jq4t"
server_key: "875d78d7c4104b797751540cf6508b92"
server_key_iv: "76754357901c95090868cfeb8941d506"
server_key_version: "encryptionkey@0"
I20260809 19:00:45.208586 23829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:45.212075 23829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:45.214229 23829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:45.214399 23829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:45.218724 23829 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36933
I20260809 19:00:45.218756 23925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36933 every 8 connection(s)
I20260809 19:00:45.219125 23829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:45.220240 23926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:45.222712 23926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92: Bootstrap starting.
I20260809 19:00:45.223353 23926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:45.223651 23926 log.cc:824] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:45.224403 23926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92: No bootstrap required, opened a new log
I20260809 19:00:45.226094 23926 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9effa985fe74133a66bd6df37ea5a92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36933 } }
I20260809 19:00:45.226243 23926 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:45.226266 23926 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9effa985fe74133a66bd6df37ea5a92, State: Initialized, Role: FOLLOWER
I20260809 19:00:45.226490 23926 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9effa985fe74133a66bd6df37ea5a92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36933 } }
I20260809 19:00:45.226583 23926 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:45.226635 23926 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:45.226688 23926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:45.227274 23926 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9effa985fe74133a66bd6df37ea5a92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36933 } }
I20260809 19:00:45.227397 23926 leader_election.cc:302] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9effa985fe74133a66bd6df37ea5a92; no voters:
I20260809 19:00:45.227605 23926 leader_election.cc:288] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:45.227671 23929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:45.227902 23929 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [term 1 LEADER]: Becoming Leader. State: Replica: e9effa985fe74133a66bd6df37ea5a92, State: Running, Role: LEADER
I20260809 19:00:45.227914 23926 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:45.228011 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 23829
I20260809 19:00:45.228080 23929 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9effa985fe74133a66bd6df37ea5a92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36933 } }
I20260809 19:00:45.228128 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:45.228333 24468 external_mini_cluster.cc:1428] Setting key ad7752fdee3a61535d7b7e26dc7aa1b8
I20260809 19:00:45.228943 23930 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9effa985fe74133a66bd6df37ea5a92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9effa985fe74133a66bd6df37ea5a92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36933 } } }
I20260809 19:00:45.229038 23930 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:45.229077 23932 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9effa985fe74133a66bd6df37ea5a92. Latest consensus state: current_term: 1 leader_uuid: "e9effa985fe74133a66bd6df37ea5a92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9effa985fe74133a66bd6df37ea5a92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36933 } } }
I20260809 19:00:45.229171 23932 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:45.229409 23948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:45.230011 23948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:45.231458 23949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:45.229370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33281 (local address 127.0.0.1:36933)
0809 19:00:45.229590 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:45.229601 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:45.229643 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:00:45.229809 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:45.229818 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:45.229854 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:45.230012 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:45.230975 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:45.230979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:45.230980 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:45.230985 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:45.231046 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:45.231062 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:45.231139 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:45.231221 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 19:00:45.231265 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
I20260809 19:00:45.232084 23948 catalog_manager.cc:1347] Generated new cluster ID: 51b6f25f999d499baf148e049f56cdfc
I20260809 19:00:45.232187 23948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:45.232604 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:45.238417 23949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:45.236958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53577 (local address 127.0.0.1:36933)
0809 19:00:45.237027 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:45.237029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:45.237278 (+ 249us) server_negotiation.cc:407] Connection header received
0809 19:00:45.237383 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:45.237384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:45.237391 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:45.237445 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:45.238146 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:45.238148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:45.238148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:45.238153 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:45.238172 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:45.238176 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:45.238231 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:45.238284 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 19:00:45.238301 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 19:00:45.244379 23948 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:45.244626 23948 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:45.251895 23948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9effa985fe74133a66bd6df37ea5a92: Generated new TSK 0
I20260809 19:00:45.252166 23948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:45.258317 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 23829
2026-08-09T19:00:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1537 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:45 dist-test-slave-jq4t krb5kdc[23970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:45 dist-test-slave-jq4t krb5kdc[23970](info): set up 2 sockets
Aug 09 19:00:45 dist-test-slave-jq4t krb5kdc[23970](info): commencing operation
krb5kdc: starting...
W20260809 19:00:46.516239 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:46 dist-test-slave-jq4t krb5kdc[23970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:46.644824 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42901
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:46.731249 23988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:46.731467 23988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:46.731491 23988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:46.732723 23988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:46.732770 23988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:46.732784 23988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:46.732805 23988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:46.732818 23988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:46.734387 23988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:46.734658 23988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:46.734908 23988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:46.739944 23994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:46.739944 23995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:46.740228 23988 server_base.cc:1034] running on GCE node
W20260809 19:00:46.739992 23997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:46.740609 23988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:46.740936 23988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:46.742084 23988 hybrid_clock.cc:648] HybridClock initialized: now 1786302046742063 us; error 39 us; skew 500 ppm
Aug 09 19:00:46 dist-test-slave-jq4t krb5kdc[23970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302046, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:46.744652 23988 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:46.745092 23988 webserver.cc:460] Webserver started at http://127.0.0.1:46683/ using document root <none> and password file <none>
I20260809 19:00:46.745350 23988 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:46.745421 23988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:46.745579 23988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:46.746673 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "4d424f56da6f4bc18f775645bebb5403"
format_stamp: "Formatted at 2026-08-09 19:00:46 on dist-test-slave-jq4t"
server_key: "745ab10fe14ff38f7e681e2ea921c269"
server_key_iv: "c37b9ced5f077ed610c2ebac661263e4"
server_key_version: "encryptionkey@0"
I20260809 19:00:46.747054 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "4d424f56da6f4bc18f775645bebb5403"
format_stamp: "Formatted at 2026-08-09 19:00:46 on dist-test-slave-jq4t"
server_key: "745ab10fe14ff38f7e681e2ea921c269"
server_key_iv: "c37b9ced5f077ed610c2ebac661263e4"
server_key_version: "encryptionkey@0"
I20260809 19:00:46.748435 23988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260809 19:00:46.749258 24008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:46.749437 23988 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:46.749548 23988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "4d424f56da6f4bc18f775645bebb5403"
format_stamp: "Formatted at 2026-08-09 19:00:46 on dist-test-slave-jq4t"
server_key: "745ab10fe14ff38f7e681e2ea921c269"
server_key_iv: "c37b9ced5f077ed610c2ebac661263e4"
server_key_version: "encryptionkey@0"
I20260809 19:00:46.749634 23988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:46.759505 23988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:46.761876 23988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:46.762109 23988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:46.766571 23988 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42901
I20260809 19:00:46.766623 24073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42901 every 8 connection(s)
I20260809 19:00:46.767023 23988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:46.767987 24074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:46.770596 24074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403: Bootstrap starting.
I20260809 19:00:46.770900 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 23988
I20260809 19:00:46.771034 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:46.771399 24468 external_mini_cluster.cc:1428] Setting key 5e709b25cb65d9a554423404830be843
I20260809 19:00:46.771668 24074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:46.772099 24074 log.cc:824] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:46.772940 24074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403: No bootstrap required, opened a new log
I20260809 19:00:46.775496 24074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d424f56da6f4bc18f775645bebb5403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42901 } }
I20260809 19:00:46.775686 24074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:46.775719 24074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d424f56da6f4bc18f775645bebb5403, State: Initialized, Role: FOLLOWER
I20260809 19:00:46.775848 24074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d424f56da6f4bc18f775645bebb5403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42901 } }
I20260809 19:00:46.775933 24074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:46.775976 24074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:46.776082 24074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:46.776862 24074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d424f56da6f4bc18f775645bebb5403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42901 } }
I20260809 19:00:46.776994 24074 leader_election.cc:302] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d424f56da6f4bc18f775645bebb5403; no voters:
I20260809 19:00:46.777626 24074 leader_election.cc:288] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:46.777683 24082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:46.777835 24082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [term 1 LEADER]: Becoming Leader. State: Replica: 4d424f56da6f4bc18f775645bebb5403, State: Running, Role: LEADER
I20260809 19:00:46.777945 24074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:46.777976 24082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d424f56da6f4bc18f775645bebb5403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42901 } }
I20260809 19:00:46.778393 24082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d424f56da6f4bc18f775645bebb5403. Latest consensus state: current_term: 1 leader_uuid: "4d424f56da6f4bc18f775645bebb5403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d424f56da6f4bc18f775645bebb5403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42901 } } }
I20260809 19:00:46.778635 24082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:46.778558 24085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d424f56da6f4bc18f775645bebb5403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d424f56da6f4bc18f775645bebb5403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42901 } } }
I20260809 19:00:46.779032 24085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:46.779276 24094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 09 19:00:46 dist-test-slave-jq4t krb5kdc[23970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:00:46.779943 24094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:46.782640 24094 catalog_manager.cc:1347] Generated new cluster ID: dfd94a37a9eb4ea3905cd4587abd800d
I20260809 19:00:46.782702 24094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:46.783887 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:46.772083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49327 (local address 127.0.0.1:42901)
0809 19:00:46.772350 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:46.772358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:46.772387 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:00:46.772919 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:46.772927 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:46.772981 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:46.773154 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:46.773982 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:46.774905 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:46.776000 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:46.776629 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:46.776732 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:46.780005 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:46.780010 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:46.780011 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:46.780026 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:46.781961 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:46.782437 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:46.782441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:46.782441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:46.782575 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:46.782828 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:46.782829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:46.782830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:46.783097 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:46.783264 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:46.783537 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 19:00:46.783692 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":104,"threads_started":1}
I20260809 19:00:46.785045 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:46.793118 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:46.786543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48201 (local address 127.0.0.1:42901)
0809 19:00:46.786583 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:46.786585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:46.786719 (+ 134us) server_negotiation.cc:407] Connection header received
0809 19:00:46.786798 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:46.786799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:46.786809 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:46.786860 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:46.787499 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:46.788004 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:46.788800 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:46.789047 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:46.789130 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:46.790423 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:46.790425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:46.790425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:46.790433 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:46.791898 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:46.792280 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:46.792281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:46.792281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:46.792350 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:46.792569 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:46.792570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:46.792571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:46.792688 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:46.792794 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:46.792926 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 19:00:46.793005 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 19:00:46.797294 24094 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:46.797838 24094 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:46.800755 24094 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d424f56da6f4bc18f775645bebb5403: Generated new TSK 0
I20260809 19:00:46.800977 24094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:46.803515 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 23988
2026-08-09T19:00:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:46 dist-test-slave-jq4t krb5kdc[24116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:46 dist-test-slave-jq4t krb5kdc[24116](info): set up 2 sockets
Aug 09 19:00:46 dist-test-slave-jq4t krb5kdc[24116](info): commencing operation
krb5kdc: starting...
W20260809 19:00:48.060747 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:48 dist-test-slave-jq4t krb5kdc[24116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:48.187417 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38517
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:48.282753 24131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:48.283015 24131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:48.283044 24131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:48.284281 24131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:48.284323 24131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:48.284338 24131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:48.284351 24131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:48.284363 24131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:48.287151 24131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:48.287598 24131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:48.287878 24131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:48.293329 24141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:48.293345 24139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:48.293351 24138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:48.293535 24131 server_base.cc:1034] running on GCE node
I20260809 19:00:48.293874 24131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:48.294165 24131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:48.295315 24131 hybrid_clock.cc:648] HybridClock initialized: now 1786302048295300 us; error 31 us; skew 500 ppm
Aug 09 19:00:48 dist-test-slave-jq4t krb5kdc[24116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302048, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:48.297962 24131 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:48.298488 24131 webserver.cc:460] Webserver started at http://127.0.0.1:46513/ using document root <none> and password file <none>
I20260809 19:00:48.298728 24131 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:48.298774 24131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:48.298950 24131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:48.300060 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "a688ebade3114c8893faec1d755e91fa"
format_stamp: "Formatted at 2026-08-09 19:00:48 on dist-test-slave-jq4t"
server_key: "330e7d5d9bd63333083606af080dca4a"
server_key_iv: "0fd02bcb96777e618f41a3308a46b6f3"
server_key_version: "encryptionkey@0"
I20260809 19:00:48.300439 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "a688ebade3114c8893faec1d755e91fa"
format_stamp: "Formatted at 2026-08-09 19:00:48 on dist-test-slave-jq4t"
server_key: "330e7d5d9bd63333083606af080dca4a"
server_key_iv: "0fd02bcb96777e618f41a3308a46b6f3"
server_key_version: "encryptionkey@0"
I20260809 19:00:48.301870 24131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:00:48.302615 24152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:48.302815 24131 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:48.302911 24131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "a688ebade3114c8893faec1d755e91fa"
format_stamp: "Formatted at 2026-08-09 19:00:48 on dist-test-slave-jq4t"
server_key: "330e7d5d9bd63333083606af080dca4a"
server_key_iv: "0fd02bcb96777e618f41a3308a46b6f3"
server_key_version: "encryptionkey@0"
I20260809 19:00:48.302973 24131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:48.314224 24131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:48.316792 24131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:48.316929 24131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:48.321092 24131 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38517
I20260809 19:00:48.321127 24218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38517 every 8 connection(s)
I20260809 19:00:48.321520 24131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:48.322502 24220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:48.323964 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24131
I20260809 19:00:48.324116 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:48.324345 24468 external_mini_cluster.cc:1428] Setting key 19245777b1fc1919221c2c852227e060
I20260809 19:00:48.325642 24220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa: Bootstrap starting.
I20260809 19:00:48.326388 24220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:48.326719 24220 log.cc:824] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:48.327468 24220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa: No bootstrap required, opened a new log
I20260809 19:00:48.329638 24220 raft_consensus.cc:348] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a688ebade3114c8893faec1d755e91fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260809 19:00:48.329813 24220 raft_consensus.cc:374] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:48.329882 24220 raft_consensus.cc:729] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a688ebade3114c8893faec1d755e91fa, State: Initialized, Role: FOLLOWER
I20260809 19:00:48.330091 24220 consensus_queue.cc:260] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a688ebade3114c8893faec1d755e91fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260809 19:00:48.330173 24220 raft_consensus.cc:388] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:48.330199 24220 raft_consensus.cc:482] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:48.330207 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.324966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43913 (local address 127.0.0.1:38517)
0809 19:00:48.325162 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:48.325171 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:48.325198 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:00:48.325634 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:48.325641 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:48.325710 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:48.325853 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:48.326124 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:48.327147 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:48.328033 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:48.328531 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:48.328654 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:48.329487 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:48.329491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:48.329492 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:48.329662 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:48.329695 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:48.329707 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:48.329781 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:48.329858 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 19:00:48.329930 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260809 19:00:48.330277 24220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:48.331086 24220 raft_consensus.cc:504] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a688ebade3114c8893faec1d755e91fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260809 19:00:48.331197 24220 leader_election.cc:302] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a688ebade3114c8893faec1d755e91fa; no voters:
I20260809 19:00:48.331329 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:48.331377 24220 leader_election.cc:288] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:48.331400 24225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:48.331578 24225 raft_consensus.cc:686] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [term 1 LEADER]: Becoming Leader. State: Replica: a688ebade3114c8893faec1d755e91fa, State: Running, Role: LEADER
I20260809 19:00:48.331692 24220 sys_catalog.cc:564] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:48.331723 24225 consensus_queue.cc:237] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a688ebade3114c8893faec1d755e91fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260809 19:00:48.332072 24225 sys_catalog.cc:455] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader a688ebade3114c8893faec1d755e91fa. Latest consensus state: current_term: 1 leader_uuid: "a688ebade3114c8893faec1d755e91fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a688ebade3114c8893faec1d755e91fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } } }
I20260809 19:00:48.332341 24225 sys_catalog.cc:458] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:48.332255 24226 sys_catalog.cc:455] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a688ebade3114c8893faec1d755e91fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a688ebade3114c8893faec1d755e91fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } } }
I20260809 19:00:48.332803 24226 sys_catalog.cc:458] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:48.333101 24237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:48.333633 24237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:48.335217 24237 catalog_manager.cc:1347] Generated new cluster ID: 3e1c21e01bc042b4a75bffe367b8578b
I20260809 19:00:48.335270 24237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:48.336875 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.333052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39245 (local address 127.0.0.1:38517)
0809 19:00:48.333090 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:48.333092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:48.333456 (+ 364us) server_negotiation.cc:407] Connection header received
0809 19:00:48.333543 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:48.333544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:48.333555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:48.333587 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:48.333782 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:48.334517 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:48.335505 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:48.335798 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:48.335872 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:48.336618 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:48.336619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:48.336619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:48.336624 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:48.336639 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:48.336643 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:48.336694 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:48.336776 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 19:00:48.336800 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 19:00:48.353724 24237 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:48.354321 24237 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:48.360388 24237 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a688ebade3114c8893faec1d755e91fa: Generated new TSK 0
I20260809 19:00:48.360631 24237 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:48.368280 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24131
2026-08-09T19:00:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1576 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:48 dist-test-slave-jq4t krb5kdc[24261](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:48 dist-test-slave-jq4t krb5kdc[24261](info): set up 2 sockets
Aug 09 19:00:48 dist-test-slave-jq4t krb5kdc[24261](info): commencing operation
krb5kdc: starting...
W20260809 19:00:49.637185 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:49 dist-test-slave-jq4t krb5kdc[24261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:49.768044 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40397
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:49.854327 24281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:49.854557 24281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:49.854583 24281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:49.855690 24281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:49.855727 24281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:49.855742 24281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:49.855754 24281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:49.855767 24281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:49.857272 24281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:49.857498 24281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:49.857689 24281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 19:00:49.862969 24281 server_base.cc:1034] running on GCE node
W20260809 19:00:49.862932 24296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:49.862941 24294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:49.862928 24292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:49.863368 24281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:49.863725 24281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:49.864894 24281 hybrid_clock.cc:648] HybridClock initialized: now 1786302049864882 us; error 48 us; skew 500 ppm
Aug 09 19:00:49 dist-test-slave-jq4t krb5kdc[24261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302049, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:49.870419 24281 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:49.870980 24281 webserver.cc:460] Webserver started at http://127.0.0.1:42065/ using document root <none> and password file <none>
I20260809 19:00:49.871253 24281 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:49.871325 24281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:49.871488 24281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:49.872699 24281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "6343ec0f4f034609ae568e94ca08b7c9"
format_stamp: "Formatted at 2026-08-09 19:00:49 on dist-test-slave-jq4t"
server_key: "7788dafa3765346faffcd112241d64c4"
server_key_iv: "db6b7a7aaf55864720ff0477dec6a09d"
server_key_version: "encryptionkey@0"
I20260809 19:00:49.873070 24281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "6343ec0f4f034609ae568e94ca08b7c9"
format_stamp: "Formatted at 2026-08-09 19:00:49 on dist-test-slave-jq4t"
server_key: "7788dafa3765346faffcd112241d64c4"
server_key_iv: "db6b7a7aaf55864720ff0477dec6a09d"
server_key_version: "encryptionkey@0"
I20260809 19:00:49.874470 24281 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 19:00:49.875257 24307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:49.875484 24281 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:49.875594 24281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "6343ec0f4f034609ae568e94ca08b7c9"
format_stamp: "Formatted at 2026-08-09 19:00:49 on dist-test-slave-jq4t"
server_key: "7788dafa3765346faffcd112241d64c4"
server_key_iv: "db6b7a7aaf55864720ff0477dec6a09d"
server_key_version: "encryptionkey@0"
I20260809 19:00:49.875670 24281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:49.879225 24281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:49.881703 24281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:49.881872 24281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:49.886229 24281 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40397
I20260809 19:00:49.886264 24377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40397 every 8 connection(s)
I20260809 19:00:49.886622 24281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:49.887652 24379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:49.890151 24379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9: Bootstrap starting.
I20260809 19:00:49.890779 24379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:49.891099 24379 log.cc:824] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:49.891811 24379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9: No bootstrap required, opened a new log
I20260809 19:00:49.893556 24379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6343ec0f4f034609ae568e94ca08b7c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40397 } }
I20260809 19:00:49.893700 24379 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:49.893723 24379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6343ec0f4f034609ae568e94ca08b7c9, State: Initialized, Role: FOLLOWER
I20260809 19:00:49.893918 24379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6343ec0f4f034609ae568e94ca08b7c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40397 } }
I20260809 19:00:49.893982 24379 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:49.894045 24379 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:49.894093 24379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:49.894244 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24281
I20260809 19:00:49.894379 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:49.894585 24468 external_mini_cluster.cc:1428] Setting key 5da2f0d01d4f1e4585d6fb380e374eee
I20260809 19:00:49.894820 24379 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6343ec0f4f034609ae568e94ca08b7c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40397 } }
I20260809 19:00:49.894946 24379 leader_election.cc:302] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6343ec0f4f034609ae568e94ca08b7c9; no voters:
I20260809 19:00:49.895136 24379 leader_election.cc:288] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:49.895184 24385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:49.895516 24379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:49.895633 24385 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [term 1 LEADER]: Becoming Leader. State: Replica: 6343ec0f4f034609ae568e94ca08b7c9, State: Running, Role: LEADER
I20260809 19:00:49.895773 24385 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6343ec0f4f034609ae568e94ca08b7c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40397 } }
I20260809 19:00:49.896164 24388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6343ec0f4f034609ae568e94ca08b7c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6343ec0f4f034609ae568e94ca08b7c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40397 } } }
I20260809 19:00:49.896180 24391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6343ec0f4f034609ae568e94ca08b7c9. Latest consensus state: current_term: 1 leader_uuid: "6343ec0f4f034609ae568e94ca08b7c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6343ec0f4f034609ae568e94ca08b7c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40397 } } }
I20260809 19:00:49.896276 24388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:49.896303 24391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:49.896705 24395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:49.897490 24395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:49.897538 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:49.895126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45213 (local address 127.0.0.1:40397)
0809 19:00:49.895323 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:49.895333 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:49.895475 (+ 142us) server_negotiation.cc:407] Connection header received
0809 19:00:49.895631 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:49.895639 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:49.895671 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:49.895836 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:49.896948 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:49.896952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:49.896952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:49.896958 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:49.897003 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:49.897018 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:49.897094 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:49.897265 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 19:00:49.897320 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260809 19:00:49.898514 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:49.899633 24395 catalog_manager.cc:1347] Generated new cluster ID: 34ea0a82ff134ca6989779a0e6df219d
I20260809 19:00:49.899675 24395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:49.901741 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:49.900158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60439 (local address 127.0.0.1:40397)
0809 19:00:49.900189 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:49.900191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:49.900751 (+ 560us) server_negotiation.cc:407] Connection header received
0809 19:00:49.900781 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:49.900782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:49.900787 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:49.900852 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:49.901534 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:49.901535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:49.901535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:49.901539 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:49.901555 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:49.901560 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:49.901614 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:49.901667 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 19:00:49.901679 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 19:00:49.928026 24395 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:49.928254 24395 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:49.943513 24395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6343ec0f4f034609ae568e94ca08b7c9: Generated new TSK 0
I20260809 19:00:49.943778 24395 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:49.948674 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24281
2026-08-09T19:00:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:50 dist-test-slave-jq4t krb5kdc[24423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:50 dist-test-slave-jq4t krb5kdc[24423](info): set up 2 sockets
Aug 09 19:00:50 dist-test-slave-jq4t krb5kdc[24423](info): commencing operation
krb5kdc: starting...
W20260809 19:00:51.202417 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:51 dist-test-slave-jq4t krb5kdc[24423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:51.331329 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36935
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:51.420220 24446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:51.420497 24446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:51.420544 24446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:51.421702 24446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:51.421772 24446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:51.421795 24446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:51.421825 24446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:51.421855 24446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:51.423349 24446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:51.423641 24446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:51.423877 24446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:51.428759 24454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:51.428864 24456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:51.428768 24452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:51.429023 24446 server_base.cc:1034] running on GCE node
I20260809 19:00:51.429287 24446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:51.429623 24446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:51.430790 24446 hybrid_clock.cc:648] HybridClock initialized: now 1786302051430785 us; error 38 us; skew 500 ppm
Aug 09 19:00:51 dist-test-slave-jq4t krb5kdc[24423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302051, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:51.433467 24446 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:51.433966 24446 webserver.cc:460] Webserver started at http://127.0.0.1:39787/ using document root <none> and password file <none>
I20260809 19:00:51.434224 24446 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:51.434293 24446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:51.434459 24446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:51.435592 24446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "602b0e88d99b4e839090e478e9aabae9"
format_stamp: "Formatted at 2026-08-09 19:00:51 on dist-test-slave-jq4t"
server_key: "91a435b091ca4502e242cb4df2034960"
server_key_iv: "417a9fc133c6a6ffe9a606a9e0d2fc8a"
server_key_version: "encryptionkey@0"
I20260809 19:00:51.435959 24446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "602b0e88d99b4e839090e478e9aabae9"
format_stamp: "Formatted at 2026-08-09 19:00:51 on dist-test-slave-jq4t"
server_key: "91a435b091ca4502e242cb4df2034960"
server_key_iv: "417a9fc133c6a6ffe9a606a9e0d2fc8a"
server_key_version: "encryptionkey@0"
I20260809 19:00:51.437424 24446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 19:00:51.438162 24466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:51.438347 24446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:00:51.438457 24446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "602b0e88d99b4e839090e478e9aabae9"
format_stamp: "Formatted at 2026-08-09 19:00:51 on dist-test-slave-jq4t"
server_key: "91a435b091ca4502e242cb4df2034960"
server_key_iv: "417a9fc133c6a6ffe9a606a9e0d2fc8a"
server_key_version: "encryptionkey@0"
I20260809 19:00:51.438534 24446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:51.467803 24446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:51.469812 24446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:51.469998 24446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:51.474341 24446 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36935
I20260809 19:00:51.474378 24547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36935 every 8 connection(s)
I20260809 19:00:51.474745 24446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:51.475668 24548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:51.477492 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24446
I20260809 19:00:51.477638 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:51.477870 24468 external_mini_cluster.cc:1428] Setting key bb8e1f9abbe06f28c868e167d829634a
I20260809 19:00:51.478713 24548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9: Bootstrap starting.
I20260809 19:00:51.479368 24548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:51.479732 24548 log.cc:824] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:51.480607 24548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9: No bootstrap required, opened a new log
I20260809 19:00:51.482875 24548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602b0e88d99b4e839090e478e9aabae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
I20260809 19:00:51.483042 24548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:51.483093 24548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 602b0e88d99b4e839090e478e9aabae9, State: Initialized, Role: FOLLOWER
I20260809 19:00:51.483261 24548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602b0e88d99b4e839090e478e9aabae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
I20260809 19:00:51.483353 24548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:51.483413 24548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:51.483469 24548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:51.484340 24548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602b0e88d99b4e839090e478e9aabae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
I20260809 19:00:51.484470 24548 leader_election.cc:302] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 602b0e88d99b4e839090e478e9aabae9; no voters:
I20260809 19:00:51.484686 24548 leader_election.cc:288] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:51.484747 24555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:51.484956 24555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [term 1 LEADER]: Becoming Leader. State: Replica: 602b0e88d99b4e839090e478e9aabae9, State: Running, Role: LEADER
I20260809 19:00:51.485035 24548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:51.485092 24555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602b0e88d99b4e839090e478e9aabae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
Aug 09 19:00:51 dist-test-slave-jq4t krb5kdc[24423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:00:51.485529 24555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 602b0e88d99b4e839090e478e9aabae9. Latest consensus state: current_term: 1 leader_uuid: "602b0e88d99b4e839090e478e9aabae9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602b0e88d99b4e839090e478e9aabae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } } }
I20260809 19:00:51.485617 24555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:51.485874 24566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:51.485541 24556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "602b0e88d99b4e839090e478e9aabae9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602b0e88d99b4e839090e478e9aabae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } } }
I20260809 19:00:51.486465 24566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:51.486526 24556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:51.488622 24566 catalog_manager.cc:1347] Generated new cluster ID: 17370eccd1ed41939729934bc6433479
I20260809 19:00:51.488704 24566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:51.490199 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:51.478637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:38755 (local address 127.0.0.1:36935)
0809 19:00:51.478935 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:51.478944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:51.478979 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:00:51.479430 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:51.479437 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:51.479530 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:51.479667 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:51.480470 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:51.481486 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:51.482673 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:51.483118 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:51.483243 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:51.486115 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:51.486119 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:51.486119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:51.486149 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:51.488323 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:51.488841 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:51.488844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:51.488845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:51.488957 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:51.489225 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:51.489225 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:51.489226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:51.489526 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:51.489664 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:51.489885 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 19:00:51.489986 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
I20260809 19:00:51.491259 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:51.504166 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:51.492743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:49019 (local address 127.0.0.1:36935)
0809 19:00:51.492776 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:51.492778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:51.496694 (+ 3916us) server_negotiation.cc:407] Connection header received
0809 19:00:51.496763 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:51.496764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:51.496775 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:51.496817 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:51.497498 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:51.498265 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:51.499308 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:51.499645 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:51.499710 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:51.501233 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:51.501234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:51.501234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:51.501242 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:51.502846 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:51.503287 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:51.503288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:51.503288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:51.503345 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:51.503588 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:51.503588 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:51.503588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:51.503731 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:51.503825 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:51.503993 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 19:00:51.504065 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":16}
I20260809 19:00:51.513391 24566 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:51.514175 24566 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:51.522181 24566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 602b0e88d99b4e839090e478e9aabae9: Generated new TSK 0
I20260809 19:00:51.522401 24566 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:51.527894 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24446
W20260809 19:00:51.550160 24421 connection.cc:535] client connection to 127.0.0.1:36935 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36935): Connection reset by peer (error 104)
2026-08-09T19:00:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1575 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:51 dist-test-slave-jq4t krb5kdc[24591](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:51 dist-test-slave-jq4t krb5kdc[24591](info): set up 2 sockets
Aug 09 19:00:51 dist-test-slave-jq4t krb5kdc[24591](info): commencing operation
krb5kdc: starting...
W20260809 19:00:52.798823 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:52 dist-test-slave-jq4t krb5kdc[24591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:52.925640 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36103
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:53.011193 24606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:53.011478 24606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:53.011523 24606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:53.012760 24606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:53.012840 24606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:53.012864 24606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:53.012884 24606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:53.012913 24606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:53.014539 24606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:53.014854 24606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:53.015115 24606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 19:00:53.020409 24606 server_base.cc:1034] running on GCE node
W20260809 19:00:53.020370 24614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:53.020376 24612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:53.020370 24611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:53.020910 24606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:53.021273 24606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:53.022428 24606 hybrid_clock.cc:648] HybridClock initialized: now 1786302053022409 us; error 42 us; skew 500 ppm
Aug 09 19:00:53 dist-test-slave-jq4t krb5kdc[24591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302053, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:53.025290 24606 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:53.025811 24606 webserver.cc:460] Webserver started at http://127.0.0.1:38453/ using document root <none> and password file <none>
I20260809 19:00:53.026089 24606 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:53.026137 24606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:53.026311 24606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:53.027452 24606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "ad5c67f6839b46568fd457ff0cd6a1e5"
format_stamp: "Formatted at 2026-08-09 19:00:53 on dist-test-slave-jq4t"
server_key: "bfc2898c4aaea7318a0b1babc40dfcab"
server_key_iv: "4eb6101b0337e0c17462c688dbc72f86"
server_key_version: "encryptionkey@0"
I20260809 19:00:53.027827 24606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "ad5c67f6839b46568fd457ff0cd6a1e5"
format_stamp: "Formatted at 2026-08-09 19:00:53 on dist-test-slave-jq4t"
server_key: "bfc2898c4aaea7318a0b1babc40dfcab"
server_key_iv: "4eb6101b0337e0c17462c688dbc72f86"
server_key_version: "encryptionkey@0"
I20260809 19:00:53.029340 24606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:53.030176 24624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:53.030396 24606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:53.030496 24606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "ad5c67f6839b46568fd457ff0cd6a1e5"
format_stamp: "Formatted at 2026-08-09 19:00:53 on dist-test-slave-jq4t"
server_key: "bfc2898c4aaea7318a0b1babc40dfcab"
server_key_iv: "4eb6101b0337e0c17462c688dbc72f86"
server_key_version: "encryptionkey@0"
I20260809 19:00:53.030575 24606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:53.043013 24606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:53.045626 24606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:53.045784 24606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:53.050172 24606 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36103
I20260809 19:00:53.050252 24695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36103 every 8 connection(s)
I20260809 19:00:53.050606 24606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:53.051409 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24606
I20260809 19:00:53.051501 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:53.051648 24697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:53.051709 24468 external_mini_cluster.cc:1428] Setting key 95e8a3a660848d1ba0213181ee27d681
I20260809 19:00:53.055312 24697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5: Bootstrap starting.
I20260809 19:00:53.056097 24697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:53.056427 24697 log.cc:824] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:53.057380 24697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5: No bootstrap required, opened a new log
I20260809 19:00:53.058120 24702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:53.052308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:54709 (local address 127.0.0.1:36103)
0809 19:00:53.052549 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:53.052560 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:53.052597 (+ 37us) server_negotiation.cc:407] Connection header received
0809 19:00:53.053039 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:53.053048 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:53.053120 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:53.053281 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:53.053437 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:53.054836 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:53.055681 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:53.056358 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:53.056516 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:53.057388 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:53.057394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:53.057395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:53.057616 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:53.057656 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:53.057672 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:53.057767 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:53.057857 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 19:00:53.057895 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":94,"threads_started":1}
I20260809 19:00:53.059418 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:53.059973 24697 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36103 } }
I20260809 19:00:53.060168 24697 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:53.060212 24697 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5c67f6839b46568fd457ff0cd6a1e5, State: Initialized, Role: FOLLOWER
I20260809 19:00:53.060395 24697 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36103 } }
I20260809 19:00:53.060510 24697 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:53.060609 24697 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:53.060683 24697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:53.061621 24697 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36103 } }
I20260809 19:00:53.061760 24697 leader_election.cc:302] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad5c67f6839b46568fd457ff0cd6a1e5; no voters:
I20260809 19:00:53.061928 24697 leader_election.cc:288] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:53.061975 24712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:53.062157 24712 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [term 1 LEADER]: Becoming Leader. State: Replica: ad5c67f6839b46568fd457ff0cd6a1e5, State: Running, Role: LEADER
I20260809 19:00:53.062227 24697 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:53.062309 24712 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36103 } }
I20260809 19:00:53.062652 24712 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad5c67f6839b46568fd457ff0cd6a1e5. Latest consensus state: current_term: 1 leader_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36103 } } }
I20260809 19:00:53.062740 24712 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:53.062665 24713 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5c67f6839b46568fd457ff0cd6a1e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36103 } } }
I20260809 19:00:53.062913 24713 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:53.063019 24727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:53.063599 24727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:53.065042 24702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:53.061152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:59801 (local address 127.0.0.1:36103)
0809 19:00:53.061210 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:53.061212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:53.061363 (+ 151us) server_negotiation.cc:407] Connection header received
0809 19:00:53.061422 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:53.061422 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:53.061431 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:53.061479 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:53.061631 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:53.062394 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:53.063470 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:53.063747 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:53.063811 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:53.064687 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:53.064689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:53.064689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:53.064694 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:53.064711 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:53.064716 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:53.064782 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:53.064954 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 19:00:53.064965 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 19:00:53.065896 24727 catalog_manager.cc:1347] Generated new cluster ID: ef036b6829a849bca84b12e0c985c7ea
I20260809 19:00:53.065953 24727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:53.074812 24727 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:53.075362 24727 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:53.077996 24727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad5c67f6839b46568fd457ff0cd6a1e5: Generated new TSK 0
I20260809 19:00:53.078189 24727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:53.081874 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24606
W20260809 19:00:53.103752 24588 connection.cc:535] client connection to 127.0.0.1:36103 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36103): Connection reset by peer (error 104)
2026-08-09T19:00:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1553 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:53 dist-test-slave-jq4t krb5kdc[24745](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:53 dist-test-slave-jq4t krb5kdc[24745](info): set up 2 sockets
Aug 09 19:00:53 dist-test-slave-jq4t krb5kdc[24745](info): commencing operation
krb5kdc: starting...
W20260809 19:00:54.349593 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:54 dist-test-slave-jq4t krb5kdc[24745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:54.479305 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34107
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:54.566536 24763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:54.566771 24763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:54.566795 24763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:54.567919 24763 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:54.567961 24763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:54.567976 24763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:54.567989 24763 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:54.568001 24763 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:54.569463 24763 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:54.569729 24763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:54.569926 24763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:54.575040 24771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:54.575035 24769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:54.575042 24773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:54.575320 24763 server_base.cc:1034] running on GCE node
I20260809 19:00:54.575608 24763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:54.575946 24763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:54.577111 24763 hybrid_clock.cc:648] HybridClock initialized: now 1786302054577106 us; error 38 us; skew 500 ppm
Aug 09 19:00:54 dist-test-slave-jq4t krb5kdc[24745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302054, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:54.579800 24763 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:54.580292 24763 webserver.cc:460] Webserver started at http://127.0.0.1:44411/ using document root <none> and password file <none>
I20260809 19:00:54.580610 24763 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:54.580688 24763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:54.580856 24763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:54.582032 24763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "57214653bb0042bf97b018ef6686f7e5"
format_stamp: "Formatted at 2026-08-09 19:00:54 on dist-test-slave-jq4t"
server_key: "bf7c225194daf94f5ab6cc586e887eff"
server_key_iv: "ab5a1e8ed26f450402d887e317d2d1a6"
server_key_version: "encryptionkey@0"
I20260809 19:00:54.582440 24763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "57214653bb0042bf97b018ef6686f7e5"
format_stamp: "Formatted at 2026-08-09 19:00:54 on dist-test-slave-jq4t"
server_key: "bf7c225194daf94f5ab6cc586e887eff"
server_key_iv: "ab5a1e8ed26f450402d887e317d2d1a6"
server_key_version: "encryptionkey@0"
I20260809 19:00:54.584019 24763 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:00:54.585119 24782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:54.585335 24763 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 19:00:54.585457 24763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "57214653bb0042bf97b018ef6686f7e5"
format_stamp: "Formatted at 2026-08-09 19:00:54 on dist-test-slave-jq4t"
server_key: "bf7c225194daf94f5ab6cc586e887eff"
server_key_iv: "ab5a1e8ed26f450402d887e317d2d1a6"
server_key_version: "encryptionkey@0"
I20260809 19:00:54.585542 24763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:54.589133 24763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:54.591265 24763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:54.591439 24763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:54.595616 24763 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34107
I20260809 19:00:54.595647 24852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34107 every 8 connection(s)
I20260809 19:00:54.596081 24763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:54.597204 24853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:54.599593 24853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5: Bootstrap starting.
I20260809 19:00:54.600200 24853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:54.600468 24853 log.cc:824] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:54.601331 24853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5: No bootstrap required, opened a new log
I20260809 19:00:54.603011 24853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57214653bb0042bf97b018ef6686f7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34107 } }
I20260809 19:00:54.603168 24853 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:54.603190 24853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57214653bb0042bf97b018ef6686f7e5, State: Initialized, Role: FOLLOWER
I20260809 19:00:54.603353 24853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57214653bb0042bf97b018ef6686f7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34107 } }
I20260809 19:00:54.603446 24853 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:54.603470 24853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:54.603502 24853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:54.604074 24853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57214653bb0042bf97b018ef6686f7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34107 } }
I20260809 19:00:54.604166 24853 leader_election.cc:302] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57214653bb0042bf97b018ef6686f7e5; no voters:
I20260809 19:00:54.604312 24853 leader_election.cc:288] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:54.604399 24858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:54.604619 24858 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [term 1 LEADER]: Becoming Leader. State: Replica: 57214653bb0042bf97b018ef6686f7e5, State: Running, Role: LEADER
I20260809 19:00:54.604676 24853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:54.604727 24858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57214653bb0042bf97b018ef6686f7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34107 } }
I20260809 19:00:54.605149 24860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57214653bb0042bf97b018ef6686f7e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57214653bb0042bf97b018ef6686f7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34107 } } }
I20260809 19:00:54.605314 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24763
I20260809 19:00:54.605381 24860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:54.605439 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:54.605309 24861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57214653bb0042bf97b018ef6686f7e5. Latest consensus state: current_term: 1 leader_uuid: "57214653bb0042bf97b018ef6686f7e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57214653bb0042bf97b018ef6686f7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34107 } } }
I20260809 19:00:54.605573 24861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:54.605662 24468 external_mini_cluster.cc:1428] Setting key 9556087bbef0d365709ce67244a254d5
I20260809 19:00:54.606041 24864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:54.606741 24864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:54.608374 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:54.606225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:57549 (local address 127.0.0.1:34107)
0809 19:00:54.606559 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:54.606569 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:54.606606 (+ 37us) server_negotiation.cc:407] Connection header received
0809 19:00:54.606736 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:54.606744 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:54.606776 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:54.607257 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:54.607814 (+ 557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:54.607817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:54.607818 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:54.607822 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:54.607860 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:54.607875 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:54.607986 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:54.608134 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 19:00:54.608182 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":82,"threads_started":1}
I20260809 19:00:54.608647 24864 catalog_manager.cc:1347] Generated new cluster ID: 9b392796ee1741898723c30b1ba1bddb
I20260809 19:00:54.608703 24864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:54.609403 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:54.613622 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:54.612576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:52357 (local address 127.0.0.1:34107)
0809 19:00:54.612635 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:54.612637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:54.612646 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:00:54.612670 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:54.612671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:54.612678 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:54.612741 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:54.613383 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:54.613384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:54.613385 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:54.613390 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:54.613409 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:54.613414 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:54.613480 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:54.613533 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 19:00:54.613547 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 19:00:54.631893 24864 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:54.632138 24864 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:54.641713 24864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57214653bb0042bf97b018ef6686f7e5: Generated new TSK 0
I20260809 19:00:54.641985 24864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:54.652814 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24763
2026-08-09T19:00:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1562 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:54 dist-test-slave-jq4t krb5kdc[24893](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:54 dist-test-slave-jq4t krb5kdc[24893](info): set up 2 sockets
Aug 09 19:00:54 dist-test-slave-jq4t krb5kdc[24893](info): commencing operation
krb5kdc: starting...
W20260809 19:00:55.899055 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:55 dist-test-slave-jq4t krb5kdc[24893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:56.027562 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34817
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:56.114289 24913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:56.114545 24913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:56.114573 24913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:56.115756 24913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:56.115797 24913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:56.115813 24913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:56.115825 24913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:56.115837 24913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:56.117432 24913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34817
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:56.117676 24913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:56.117869 24913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:56.123114 24923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:56.123339 24913 server_base.cc:1034] running on GCE node
W20260809 19:00:56.123142 24921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:56.123193 24926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:56.123665 24913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:56.124010 24913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:56.125186 24913 hybrid_clock.cc:648] HybridClock initialized: now 1786302056125169 us; error 46 us; skew 500 ppm
Aug 09 19:00:56 dist-test-slave-jq4t krb5kdc[24893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302056, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:56.134523 24913 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:56.135074 24913 webserver.cc:460] Webserver started at http://127.0.0.1:39511/ using document root <none> and password file <none>
I20260809 19:00:56.135324 24913 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:56.135394 24913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:56.135553 24913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:56.136770 24913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "36cd0203c9704a8e90fed95debcd89e5"
format_stamp: "Formatted at 2026-08-09 19:00:56 on dist-test-slave-jq4t"
server_key: "5d00d04fae01924d898e496d8c7c5fef"
server_key_iv: "c7ff18e56407d2ccc95af2975eaaa029"
server_key_version: "encryptionkey@0"
I20260809 19:00:56.137161 24913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "36cd0203c9704a8e90fed95debcd89e5"
format_stamp: "Formatted at 2026-08-09 19:00:56 on dist-test-slave-jq4t"
server_key: "5d00d04fae01924d898e496d8c7c5fef"
server_key_iv: "c7ff18e56407d2ccc95af2975eaaa029"
server_key_version: "encryptionkey@0"
I20260809 19:00:56.138613 24913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 19:00:56.139460 24939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:56.139685 24913 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:56.139806 24913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "36cd0203c9704a8e90fed95debcd89e5"
format_stamp: "Formatted at 2026-08-09 19:00:56 on dist-test-slave-jq4t"
server_key: "5d00d04fae01924d898e496d8c7c5fef"
server_key_iv: "c7ff18e56407d2ccc95af2975eaaa029"
server_key_version: "encryptionkey@0"
I20260809 19:00:56.139887 24913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:56.148419 24913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:56.150354 24913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:56.150527 24913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:56.154922 24913 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34817
I20260809 19:00:56.154958 25012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34817 every 8 connection(s)
I20260809 19:00:56.155323 24913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:56.156211 25014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:56.158586 25014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5: Bootstrap starting.
I20260809 19:00:56.159200 25014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:56.159514 25014 log.cc:824] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:56.160347 25014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5: No bootstrap required, opened a new log
I20260809 19:00:56.162025 25014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36cd0203c9704a8e90fed95debcd89e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 19:00:56.162168 25014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:56.162190 25014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36cd0203c9704a8e90fed95debcd89e5, State: Initialized, Role: FOLLOWER
I20260809 19:00:56.162365 25014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36cd0203c9704a8e90fed95debcd89e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 19:00:56.162431 25014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:56.162494 25014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:56.162552 25014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:56.163146 25014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36cd0203c9704a8e90fed95debcd89e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 19:00:56.163239 25014 leader_election.cc:302] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36cd0203c9704a8e90fed95debcd89e5; no voters:
I20260809 19:00:56.163466 25014 leader_election.cc:288] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:56.163519 25018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:56.163792 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 24913
I20260809 19:00:56.163782 25018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [term 1 LEADER]: Becoming Leader. State: Replica: 36cd0203c9704a8e90fed95debcd89e5, State: Running, Role: LEADER
I20260809 19:00:56.163916 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:56.163786 25014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:56.163934 25018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36cd0203c9704a8e90fed95debcd89e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 19:00:56.164132 24468 external_mini_cluster.cc:1428] Setting key 772afa65842bb867a3a46347a65675c5
I20260809 19:00:56.164409 25020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36cd0203c9704a8e90fed95debcd89e5. Latest consensus state: current_term: 1 leader_uuid: "36cd0203c9704a8e90fed95debcd89e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36cd0203c9704a8e90fed95debcd89e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } } }
I20260809 19:00:56.164528 25020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:56.164551 25019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36cd0203c9704a8e90fed95debcd89e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36cd0203c9704a8e90fed95debcd89e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } } }
I20260809 19:00:56.164629 25019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:56.165162 25024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:56.165745 25024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:56.167975 25024 catalog_manager.cc:1347] Generated new cluster ID: 1aa19cf6630c4044b66441f16ebab85d
I20260809 19:00:56.168048 25024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 19:00:56 dist-test-slave-jq4t krb5kdc[24893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:00:56.177865 25026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:56.164737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:48263 (local address 127.0.0.1:34817)
0809 19:00:56.164978 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:56.164989 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:56.166626 (+ 1637us) server_negotiation.cc:407] Connection header received
0809 19:00:56.166781 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:56.166789 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:56.166872 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:56.167014 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:56.167671 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:56.169178 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:56.170275 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:56.170936 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:56.171053 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:56.174040 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:56.174045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:56.174046 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:56.174058 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:56.176068 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:56.176576 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:56.176579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:56.176579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:56.176687 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:56.176942 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:56.176942 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:56.176943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:56.177248 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:56.177408 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:56.177534 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 19:00:56.177632 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":58,"threads_started":1}
I20260809 19:00:56.178920 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:56.194011 25024 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:56.194741 25024 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:56.200799 25026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:56.192970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:49895 (local address 127.0.0.1:34817)
0809 19:00:56.193025 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:56.193027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:56.193132 (+ 105us) server_negotiation.cc:407] Connection header received
0809 19:00:56.193194 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:56.193194 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:56.193206 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:56.193275 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:56.194049 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:56.194773 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:56.195816 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:56.196154 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:56.196230 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:56.197762 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:56.197763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:56.197764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:56.197772 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:56.199491 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:56.199926 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:56.199927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:56.199928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:56.199994 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:56.200231 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:56.200231 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:56.200232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:56.200370 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:56.200520 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:56.200626 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 19:00:56.200701 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 19:00:56.206802 25024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36cd0203c9704a8e90fed95debcd89e5: Generated new TSK 0
I20260809 19:00:56.207044 25024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:56.211403 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 24913
W20260809 19:00:56.223807 24891 connection.cc:535] client connection to 127.0.0.1:34817 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34817): Connection reset by peer (error 104)
2026-08-09T19:00:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1557 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:56 dist-test-slave-jq4t krb5kdc[25054](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:56 dist-test-slave-jq4t krb5kdc[25054](info): set up 2 sockets
Aug 09 19:00:56 dist-test-slave-jq4t krb5kdc[25054](info): commencing operation
krb5kdc: starting...
W20260809 19:00:57.480661 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:57 dist-test-slave-jq4t krb5kdc[25054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:57.607774 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45133
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:57.697587 25072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:57.697868 25072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:57.697912 25072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:57.699128 25072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:57.699205 25072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:57.699230 25072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:57.699250 25072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:57.699282 25072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:57.700944 25072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45133
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:57.701251 25072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:57.701502 25072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:57.706610 25078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:57.706626 25082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:57.706632 25079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:57.707023 25072 server_base.cc:1034] running on GCE node
I20260809 19:00:57.707321 25072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:57.707662 25072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:57.708813 25072 hybrid_clock.cc:648] HybridClock initialized: now 1786302057708796 us; error 30 us; skew 500 ppm
Aug 09 19:00:57 dist-test-slave-jq4t krb5kdc[25054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302057, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:57.711484 25072 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:57.711999 25072 webserver.cc:460] Webserver started at http://127.0.0.1:33649/ using document root <none> and password file <none>
I20260809 19:00:57.712240 25072 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:57.712312 25072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:57.712522 25072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:57.713640 25072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "f6e1d715089444f08d9734144ded3b9e"
format_stamp: "Formatted at 2026-08-09 19:00:57 on dist-test-slave-jq4t"
server_key: "7147a30b5be94afa067c18431b82398a"
server_key_iv: "d9b313757bd293dfd376ed0bc2a31266"
server_key_version: "encryptionkey@0"
I20260809 19:00:57.714023 25072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "f6e1d715089444f08d9734144ded3b9e"
format_stamp: "Formatted at 2026-08-09 19:00:57 on dist-test-slave-jq4t"
server_key: "7147a30b5be94afa067c18431b82398a"
server_key_iv: "d9b313757bd293dfd376ed0bc2a31266"
server_key_version: "encryptionkey@0"
I20260809 19:00:57.715551 25072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:00:57.716358 25090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:57.716594 25072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:00:57.716696 25072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "f6e1d715089444f08d9734144ded3b9e"
format_stamp: "Formatted at 2026-08-09 19:00:57 on dist-test-slave-jq4t"
server_key: "7147a30b5be94afa067c18431b82398a"
server_key_iv: "d9b313757bd293dfd376ed0bc2a31266"
server_key_version: "encryptionkey@0"
I20260809 19:00:57.716773 25072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:57.741515 25072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:57.743583 25072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:57.743772 25072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:57.748268 25072 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45133
I20260809 19:00:57.748373 25172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45133 every 8 connection(s)
I20260809 19:00:57.748739 25072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:57.749678 25173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:57.752040 25173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e: Bootstrap starting.
I20260809 19:00:57.752633 25173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:57.752877 25173 log.cc:824] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:57.753639 25173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e: No bootstrap required, opened a new log
I20260809 19:00:57.753958 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25072
I20260809 19:00:57.754078 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:57.754263 24468 external_mini_cluster.cc:1428] Setting key 5b6d892171c360d02c56326931a813a0
I20260809 19:00:57.756032 25173 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6e1d715089444f08d9734144ded3b9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45133 } }
I20260809 19:00:57.756225 25173 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:57.756273 25173 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e1d715089444f08d9734144ded3b9e, State: Initialized, Role: FOLLOWER
I20260809 19:00:57.756428 25173 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6e1d715089444f08d9734144ded3b9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45133 } }
I20260809 19:00:57.756551 25173 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:57.756587 25173 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:57.756634 25173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:57.757356 25173 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6e1d715089444f08d9734144ded3b9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45133 } }
I20260809 19:00:57.757474 25173 leader_election.cc:302] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6e1d715089444f08d9734144ded3b9e; no voters:
I20260809 19:00:57.757619 25173 leader_election.cc:288] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:57.757678 25178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:57.757871 25173 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:57.757879 25178 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [term 1 LEADER]: Becoming Leader. State: Replica: f6e1d715089444f08d9734144ded3b9e, State: Running, Role: LEADER
I20260809 19:00:57.759368 25178 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6e1d715089444f08d9734144ded3b9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45133 } }
I20260809 19:00:57.759912 25179 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6e1d715089444f08d9734144ded3b9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6e1d715089444f08d9734144ded3b9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45133 } } }
I20260809 19:00:57.760008 25181 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6e1d715089444f08d9734144ded3b9e. Latest consensus state: current_term: 1 leader_uuid: "f6e1d715089444f08d9734144ded3b9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6e1d715089444f08d9734144ded3b9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45133 } } }
I20260809 19:00:57.760016 25179 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:57.760092 25181 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e [sys.catalog]: This master's current role is: LEADER
W20260809 19:00:57.761001 25197 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:00:57.761312 25197 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:00:57.761461 25201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:57.761546 25177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:57.754845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:48747 (local address 127.0.0.1:45133)
0809 19:00:57.755069 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:57.755079 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:57.755116 (+ 37us) server_negotiation.cc:407] Connection header received
0809 19:00:57.755573 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:57.755583 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:57.755663 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:57.755829 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:57.756008 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:57.757766 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:57.759048 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:57.759648 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:57.759756 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:57.760624 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:57.760629 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:57.760629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:57.760796 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:57.760827 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:57.760837 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:57.760945 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:57.761188 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 19:00:57.761222 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":103,"threads_started":1}
I20260809 19:00:57.761713 25201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:57.762650 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:57.763386 25201 catalog_manager.cc:1347] Generated new cluster ID: 5542ce40e81246e39f46d56045ad51a1
I20260809 19:00:57.763450 25201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:57.768160 25177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:57.764192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:60283 (local address 127.0.0.1:45133)
0809 19:00:57.764235 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:57.764236 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:57.764677 (+ 441us) server_negotiation.cc:407] Connection header received
0809 19:00:57.764742 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:57.764743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:57.764754 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:57.764812 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:57.764949 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:57.765658 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:57.766715 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:57.767024 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:57.767083 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:57.767894 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:57.767895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:57.767895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:57.767900 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:57.767914 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:57.767919 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:57.767974 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:57.768072 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 19:00:57.768082 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 19:00:57.771206 25201 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:57.771982 25201 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:57.780505 25201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6e1d715089444f08d9734144ded3b9e: Generated new TSK 0
I20260809 19:00:57.780704 25201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:57.784333 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25072
W20260809 19:00:57.802351 25052 connection.cc:535] client connection to 127.0.0.1:45133 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45133): Connection reset by peer (error 104)
2026-08-09T19:00:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:57 dist-test-slave-jq4t krb5kdc[25216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:57 dist-test-slave-jq4t krb5kdc[25216](info): set up 2 sockets
Aug 09 19:00:57 dist-test-slave-jq4t krb5kdc[25216](info): commencing operation
krb5kdc: starting...
W20260809 19:00:59.040032 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:00:59 dist-test-slave-jq4t krb5kdc[25216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:00:59.167785 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35415
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:59.253768 25235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:59.254027 25235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:59.254068 25235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:59.255263 25235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:59.255332 25235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:59.255357 25235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:59.255378 25235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:59.255409 25235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:59.256995 25235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35415
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:00:59.257275 25235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:59.257516 25235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:59.262522 25246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:59.262526 25244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:59.262624 25241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:59.262851 25235 server_base.cc:1034] running on GCE node
I20260809 19:00:59.263124 25235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:59.263480 25235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:59.264652 25235 hybrid_clock.cc:648] HybridClock initialized: now 1786302059264643 us; error 37 us; skew 500 ppm
Aug 09 19:00:59 dist-test-slave-jq4t krb5kdc[25216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302059, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:59.267381 25235 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:00:59.267892 25235 webserver.cc:460] Webserver started at http://127.0.0.1:37941/ using document root <none> and password file <none>
I20260809 19:00:59.268136 25235 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:59.268209 25235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:59.268378 25235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:59.269544 25235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "ce059b93135c4e14a9225bade5a5c2ae"
format_stamp: "Formatted at 2026-08-09 19:00:59 on dist-test-slave-jq4t"
server_key: "746d3bdfbef412dd43e814cfd583cc0a"
server_key_iv: "f9e4411e94172368f18c22e03df10404"
server_key_version: "encryptionkey@0"
I20260809 19:00:59.269948 25235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "ce059b93135c4e14a9225bade5a5c2ae"
format_stamp: "Formatted at 2026-08-09 19:00:59 on dist-test-slave-jq4t"
server_key: "746d3bdfbef412dd43e814cfd583cc0a"
server_key_iv: "f9e4411e94172368f18c22e03df10404"
server_key_version: "encryptionkey@0"
I20260809 19:00:59.271338 25235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:00:59.272123 25256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:59.272303 25235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:00:59.272421 25235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "ce059b93135c4e14a9225bade5a5c2ae"
format_stamp: "Formatted at 2026-08-09 19:00:59 on dist-test-slave-jq4t"
server_key: "746d3bdfbef412dd43e814cfd583cc0a"
server_key_iv: "f9e4411e94172368f18c22e03df10404"
server_key_version: "encryptionkey@0"
I20260809 19:00:59.272519 25235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:59.275936 25235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:59.278460 25235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:59.278628 25235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:59.282781 25235 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35415
I20260809 19:00:59.282814 25338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35415 every 8 connection(s)
I20260809 19:00:59.283172 25235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:59.283773 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25235
I20260809 19:00:59.283917 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:00:59.284179 24468 external_mini_cluster.cc:1428] Setting key 5e4711f594de38f769c23ee5ffa9e620
I20260809 19:00:59.284528 25340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:59.287019 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:59.284745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:45047 (local address 127.0.0.1:35415)
0809 19:00:59.284918 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:59.284927 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:59.284965 (+ 38us) server_negotiation.cc:407] Connection header received
0809 19:00:59.285664 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:59.285672 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:59.285697 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:59.285859 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:59.286514 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:59.286518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:59.286518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:59.286522 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:59.286573 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:59.286583 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:59.286640 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:59.286744 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 19:00:59.286808 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260809 19:00:59.288189 25340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae: Bootstrap starting.
I20260809 19:00:59.288285 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:00:59.288934 25340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:59.289248 25340 log.cc:824] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:59.290071 25340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae: No bootstrap required, opened a new log
I20260809 19:00:59.291011 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:59.289907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:36221 (local address 127.0.0.1:35415)
0809 19:00:59.289966 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:59.289968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:59.290112 (+ 144us) server_negotiation.cc:407] Connection header received
0809 19:00:59.290164 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:59.290165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:59.290171 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:59.290225 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:59.290762 (+ 537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:59.290763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:59.290763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:00:59.290767 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:59.290781 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:00:59.290784 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:59.290856 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:59.290927 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 19:00:59.290938 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 19:00:59.292445 25340 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce059b93135c4e14a9225bade5a5c2ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35415 } }
I20260809 19:00:59.292675 25340 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:59.292729 25340 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce059b93135c4e14a9225bade5a5c2ae, State: Initialized, Role: FOLLOWER
I20260809 19:00:59.292855 25340 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce059b93135c4e14a9225bade5a5c2ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35415 } }
I20260809 19:00:59.292953 25340 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:59.292999 25340 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:59.293051 25340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:59.293610 25340 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce059b93135c4e14a9225bade5a5c2ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35415 } }
I20260809 19:00:59.293730 25340 leader_election.cc:302] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce059b93135c4e14a9225bade5a5c2ae; no voters:
I20260809 19:00:59.293896 25340 leader_election.cc:288] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:59.293951 25354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:59.294067 25354 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [term 1 LEADER]: Becoming Leader. State: Replica: ce059b93135c4e14a9225bade5a5c2ae, State: Running, Role: LEADER
I20260809 19:00:59.294183 25340 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:59.294214 25354 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce059b93135c4e14a9225bade5a5c2ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35415 } }
I20260809 19:00:59.294601 25357 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce059b93135c4e14a9225bade5a5c2ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce059b93135c4e14a9225bade5a5c2ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35415 } } }
I20260809 19:00:59.294589 25358 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce059b93135c4e14a9225bade5a5c2ae. Latest consensus state: current_term: 1 leader_uuid: "ce059b93135c4e14a9225bade5a5c2ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce059b93135c4e14a9225bade5a5c2ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35415 } } }
I20260809 19:00:59.294776 25357 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:59.294895 25358 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:59.295288 25364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:59.295832 25364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:59.297386 25364 catalog_manager.cc:1347] Generated new cluster ID: 3f4315eb51ee4b8aa620dfeec5446f06
I20260809 19:00:59.297461 25364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:59.318805 25364 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:59.319041 25364 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:59.323624 25364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce059b93135c4e14a9225bade5a5c2ae: Generated new TSK 0
I20260809 19:00:59.323843 25364 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:00:59.331374 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25235
2026-08-09T19:00:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1538 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:00:59 dist-test-slave-jq4t krb5kdc[25388](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:00:59 dist-test-slave-jq4t krb5kdc[25388](info): set up 2 sockets
Aug 09 19:00:59 dist-test-slave-jq4t krb5kdc[25388](info): commencing operation
krb5kdc: starting...
W20260809 19:01:00.576325 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:00 dist-test-slave-jq4t krb5kdc[25388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:00.700981 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41075
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:41075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:00.787434 25407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:00.787698 25407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:00.787737 25407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:00.788928 25407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:00.789002 25407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:00.789026 25407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:00.789045 25407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:00.789077 25407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:00.790580 25407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:41075
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:41075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:00.790889 25407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:00.791136 25407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:00.796159 25416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:00.796224 25418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:00.796164 25421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:00.796574 25407 server_base.cc:1034] running on GCE node
I20260809 19:01:00.796854 25407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:00.797165 25407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:00.798350 25407 hybrid_clock.cc:648] HybridClock initialized: now 1786302060798330 us; error 32 us; skew 500 ppm
Aug 09 19:01:00 dist-test-slave-jq4t krb5kdc[25388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302060, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:00.801049 25407 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:00.801514 25407 webserver.cc:460] Webserver started at http://127.23.229.62:46085/ using document root <none> and password file <none>
I20260809 19:01:00.801755 25407 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:00.801824 25407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:00.801982 25407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:00.803103 25407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "5d95f80ea7ee4638a52db0e6a11904b1"
format_stamp: "Formatted at 2026-08-09 19:01:00 on dist-test-slave-jq4t"
server_key: "5e6e98edc9bd309d30a5eb8014ef18e4"
server_key_iv: "6582898d854596ca928cd5d1274c4407"
server_key_version: "encryptionkey@0"
I20260809 19:01:00.803498 25407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "5d95f80ea7ee4638a52db0e6a11904b1"
format_stamp: "Formatted at 2026-08-09 19:01:00 on dist-test-slave-jq4t"
server_key: "5e6e98edc9bd309d30a5eb8014ef18e4"
server_key_iv: "6582898d854596ca928cd5d1274c4407"
server_key_version: "encryptionkey@0"
I20260809 19:01:00.804921 25407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:01:00.805653 25429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:00.805833 25407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:01:00.805943 25407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "5d95f80ea7ee4638a52db0e6a11904b1"
format_stamp: "Formatted at 2026-08-09 19:01:00 on dist-test-slave-jq4t"
server_key: "5e6e98edc9bd309d30a5eb8014ef18e4"
server_key_iv: "6582898d854596ca928cd5d1274c4407"
server_key_version: "encryptionkey@0"
I20260809 19:01:00.806025 25407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:00.834617 25407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:00.837313 25407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:00.837512 25407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:00.841996 25407 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:41075
I20260809 19:01:00.842036 25506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:41075 every 8 connection(s)
I20260809 19:01:00.842420 25407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:00.843346 25508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:00.845669 25508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1: Bootstrap starting.
I20260809 19:01:00.846251 25508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:00.846491 25508 log.cc:824] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:00.847011 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25407
I20260809 19:01:00.847136 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:00.847302 25508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1: No bootstrap required, opened a new log
I20260809 19:01:00.847342 24468 external_mini_cluster.cc:1428] Setting key 7444b2c7e3971ab71a8fc1aa3ec532ce
I20260809 19:01:00.849787 25508 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41075 } }
I20260809 19:01:00.849920 25508 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:00.849949 25508 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d95f80ea7ee4638a52db0e6a11904b1, State: Initialized, Role: FOLLOWER
I20260809 19:01:00.850082 25508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41075 } }
I20260809 19:01:00.850155 25508 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:00.850178 25508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:00.850245 25508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:00.850826 25508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41075 } }
I20260809 19:01:00.850916 25508 leader_election.cc:302] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d95f80ea7ee4638a52db0e6a11904b1; no voters:
I20260809 19:01:00.851148 25508 leader_election.cc:288] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:00.851172 25515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:00.851389 25515 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [term 1 LEADER]: Becoming Leader. State: Replica: 5d95f80ea7ee4638a52db0e6a11904b1, State: Running, Role: LEADER
I20260809 19:01:00.851493 25508 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:00.851536 25515 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41075 } }
I20260809 19:01:00.851878 25515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d95f80ea7ee4638a52db0e6a11904b1. Latest consensus state: current_term: 1 leader_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41075 } } }
I20260809 19:01:00.851891 25516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d95f80ea7ee4638a52db0e6a11904b1" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 41075 } } }
I20260809 19:01:00.851960 25515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:00.852077 25516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:00.852268 25523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:00.853040 25523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:00.854882 25523 catalog_manager.cc:1347] Generated new cluster ID: e272253c30314b7dbc9db7b9becd0eea
I20260809 19:01:00.854957 25523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 19:01:00 dist-test-slave-jq4t krb5kdc[25388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:00.860333 25514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:00.847884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57111 (local address 127.23.229.62:41075)
0809 19:01:00.848095 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:00.848104 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:00.848139 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:01:00.848715 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:00.848722 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:00.848770 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:00.848882 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:00.849688 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:00.851133 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:00.852199 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:00.853040 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:00.853164 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:00.856360 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:00.856365 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:00.856366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:00.856379 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:00.858350 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:00.858846 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:00.858849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:00.858849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:00.858964 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:00.859225 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:00.859226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:00.859226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:00.859518 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:00.859664 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:00.859842 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 19:01:00.859954 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":129,"threads_started":1}
I20260809 19:01:00.861407 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:00.866575 25523 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:00.867065 25523 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:00.870317 25514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:00.863002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43969 (local address 127.23.229.62:41075)
0809 19:01:00.863049 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:00.863051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:00.863106 (+ 55us) server_negotiation.cc:407] Connection header received
0809 19:01:00.863182 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:00.863183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:00.863192 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:00.863241 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:00.863870 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:00.864662 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:00.865692 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:00.865997 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:00.866070 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:00.867493 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:00.867495 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:00.867495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:00.867502 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:00.869079 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:00.869504 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:00.869504 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:00.869505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:00.869561 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:00.869796 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:00.869797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:00.869797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:00.869911 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:00.870010 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:00.870169 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 19:01:00.870230 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 19:01:00.871879 25523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d95f80ea7ee4638a52db0e6a11904b1: Generated new TSK 0
I20260809 19:01:00.872062 25523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:00.877106 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25407
W20260809 19:01:00.892338 25385 connection.cc:535] client connection to 127.23.229.62:41075 recv error: Network error: failed to read from TLS socket (remote: 127.23.229.62:41075): Connection reset by peer (error 104)
2026-08-09T19:01:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1551 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:00 dist-test-slave-jq4t krb5kdc[25550](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:00 dist-test-slave-jq4t krb5kdc[25550](info): set up 2 sockets
Aug 09 19:01:00 dist-test-slave-jq4t krb5kdc[25550](info): commencing operation
krb5kdc: starting...
W20260809 19:01:02.120599 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:02 dist-test-slave-jq4t krb5kdc[25550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:02.245090 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:44931
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:44931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:02.330859 25570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:02.331081 25570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:02.331105 25570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:02.332283 25570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:02.332329 25570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:02.332342 25570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:02.332356 25570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:02.332373 25570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:02.333912 25570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:44931
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:44931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:02.334182 25570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:02.334422 25570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:02.339469 25576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:02.339486 25582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:02.339514 25579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:02.339598 25570 server_base.cc:1034] running on GCE node
I20260809 19:01:02.340034 25570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:02.340332 25570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:02.341491 25570 hybrid_clock.cc:648] HybridClock initialized: now 1786302062341480 us; error 28 us; skew 500 ppm
Aug 09 19:01:02 dist-test-slave-jq4t krb5kdc[25550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302062, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:02.348745 25570 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:02.349331 25570 webserver.cc:460] Webserver started at http://127.23.229.62:43561/ using document root <none> and password file <none>
I20260809 19:01:02.349659 25570 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:02.349758 25570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:02.349906 25570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:02.351128 25570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "a9e61477ca2e417e9a99dbe573d23e61"
format_stamp: "Formatted at 2026-08-09 19:01:02 on dist-test-slave-jq4t"
server_key: "8a9d1cbe5bef35dbf214cf4a93556272"
server_key_iv: "9163a90af5b64071ee041fe194a03924"
server_key_version: "encryptionkey@0"
I20260809 19:01:02.351522 25570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "a9e61477ca2e417e9a99dbe573d23e61"
format_stamp: "Formatted at 2026-08-09 19:01:02 on dist-test-slave-jq4t"
server_key: "8a9d1cbe5bef35dbf214cf4a93556272"
server_key_iv: "9163a90af5b64071ee041fe194a03924"
server_key_version: "encryptionkey@0"
I20260809 19:01:02.353026 25570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 19:01:02.353811 25591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:02.353977 25570 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:01:02.354095 25570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "a9e61477ca2e417e9a99dbe573d23e61"
format_stamp: "Formatted at 2026-08-09 19:01:02 on dist-test-slave-jq4t"
server_key: "8a9d1cbe5bef35dbf214cf4a93556272"
server_key_iv: "9163a90af5b64071ee041fe194a03924"
server_key_version: "encryptionkey@0"
I20260809 19:01:02.354172 25570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:02.363193 25570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:02.365586 25570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:02.365763 25570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:02.370039 25570 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:44931
I20260809 19:01:02.370074 25669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:44931 every 8 connection(s)
I20260809 19:01:02.370463 25570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:02.371482 25670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:02.374044 25670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61: Bootstrap starting.
I20260809 19:01:02.374711 25670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:02.375020 25670 log.cc:824] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:02.375878 25670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61: No bootstrap required, opened a new log
I20260809 19:01:02.377700 25670 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9e61477ca2e417e9a99dbe573d23e61" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44931 } }
I20260809 19:01:02.377858 25670 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:02.377883 25670 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9e61477ca2e417e9a99dbe573d23e61, State: Initialized, Role: FOLLOWER
I20260809 19:01:02.378058 25670 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9e61477ca2e417e9a99dbe573d23e61" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44931 } }
I20260809 19:01:02.378129 25670 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:02.378151 25670 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:02.378201 25670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:02.379148 25670 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9e61477ca2e417e9a99dbe573d23e61" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44931 } }
I20260809 19:01:02.379290 25670 leader_election.cc:302] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9e61477ca2e417e9a99dbe573d23e61; no voters:
I20260809 19:01:02.379510 25670 leader_election.cc:288] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:02.379554 25675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:02.379736 25675 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [term 1 LEADER]: Becoming Leader. State: Replica: a9e61477ca2e417e9a99dbe573d23e61, State: Running, Role: LEADER
I20260809 19:01:02.379808 25670 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:02.379901 25675 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9e61477ca2e417e9a99dbe573d23e61" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44931 } }
I20260809 19:01:02.380293 25677 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9e61477ca2e417e9a99dbe573d23e61. Latest consensus state: current_term: 1 leader_uuid: "a9e61477ca2e417e9a99dbe573d23e61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9e61477ca2e417e9a99dbe573d23e61" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44931 } } }
I20260809 19:01:02.380403 25677 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:02.380568 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25570
I20260809 19:01:02.380687 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:02.380930 24468 external_mini_cluster.cc:1428] Setting key a0b7369471c51ff1d83ee560b97f4858
I20260809 19:01:02.380290 25676 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9e61477ca2e417e9a99dbe573d23e61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9e61477ca2e417e9a99dbe573d23e61" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 44931 } } }
I20260809 19:01:02.381215 25676 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61 [sys.catalog]: This master's current role is: LEADER
W20260809 19:01:02.381825 25696 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:01:02.381896 25696 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:01:02.382054 25683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:02.382247 25683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:02.383999 25683 catalog_manager.cc:1347] Generated new cluster ID: 526e85e3e96141108c40233e055ccfa5
I20260809 19:01:02.384063 25683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:02.387210 25699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:02.381428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34421 (local address 127.23.229.62:44931)
0809 19:01:02.381766 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:02.381777 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:02.381811 (+ 34us) server_negotiation.cc:407] Connection header received
0809 19:01:02.381941 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:02.381948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:02.382017 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:02.382155 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:02.382514 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:02.383706 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:02.384889 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:02.385537 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:02.385656 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:02.386443 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:02.386447 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:02.386447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:02.386686 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:02.386728 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:02.386744 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:02.386839 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:02.386929 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 19:01:02.386959 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":82,"threads_started":1}
I20260809 19:01:02.388324 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:02.393723 25699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:02.390160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56689 (local address 127.23.229.62:44931)
0809 19:01:02.390200 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:02.390202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:02.390279 (+ 77us) server_negotiation.cc:407] Connection header received
0809 19:01:02.390338 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:02.390339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:02.390356 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:02.390409 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:02.390533 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:02.391275 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:02.392320 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:02.392665 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:02.392726 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:02.393455 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:02.393457 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:02.393457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:02.393462 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:02.393478 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:02.393482 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:02.393536 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:02.393636 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 19:01:02.393648 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 19:01:02.395882 25683 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:02.396423 25683 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:02.415343 25683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9e61477ca2e417e9a99dbe573d23e61: Generated new TSK 0
I20260809 19:01:02.415604 25683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:02.423805 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25570
W20260809 19:01:02.438004 25548 connection.cc:535] client connection to 127.23.229.62:44931 recv error: Network error: failed to read from TLS socket (remote: 127.23.229.62:44931): Connection reset by peer (error 104)
2026-08-09T19:01:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1545 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:02 dist-test-slave-jq4t krb5kdc[25714](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:02 dist-test-slave-jq4t krb5kdc[25714](info): set up 2 sockets
Aug 09 19:01:02 dist-test-slave-jq4t krb5kdc[25714](info): commencing operation
krb5kdc: starting...
W20260809 19:01:03.671684 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:03 dist-test-slave-jq4t krb5kdc[25714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:03.798933 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43205
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:03.884117 25735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:03.884332 25735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:03.884356 25735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:03.885596 25735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:03.885641 25735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:03.885656 25735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:03.885669 25735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:03.885681 25735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:03.887267 25735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43205
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:03.887534 25735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:03.887779 25735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:03.892706 25746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:03.892765 25741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:03.892701 25742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:03.893169 25735 server_base.cc:1034] running on GCE node
I20260809 19:01:03.893392 25735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:03.893627 25735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:03.894773 25735 hybrid_clock.cc:648] HybridClock initialized: now 1786302063894760 us; error 30 us; skew 500 ppm
Aug 09 19:01:03 dist-test-slave-jq4t krb5kdc[25714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302063, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:03.897449 25735 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:03.897955 25735 webserver.cc:460] Webserver started at http://127.23.229.62:32931/ using document root <none> and password file <none>
I20260809 19:01:03.898213 25735 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:03.898260 25735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:03.898439 25735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:03.899525 25735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "b0e8454f23e843f39e6fd1bea0d4185d"
format_stamp: "Formatted at 2026-08-09 19:01:03 on dist-test-slave-jq4t"
server_key: "7918f59809c55d3868be36e4e3c0395b"
server_key_iv: "4d11844696cad4d0450cb59db2b65b4c"
server_key_version: "encryptionkey@0"
I20260809 19:01:03.899878 25735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "b0e8454f23e843f39e6fd1bea0d4185d"
format_stamp: "Formatted at 2026-08-09 19:01:03 on dist-test-slave-jq4t"
server_key: "7918f59809c55d3868be36e4e3c0395b"
server_key_iv: "4d11844696cad4d0450cb59db2b65b4c"
server_key_version: "encryptionkey@0"
I20260809 19:01:03.901373 25735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:01:03.902200 25754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:03.902374 25735 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:01:03.902494 25735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "b0e8454f23e843f39e6fd1bea0d4185d"
format_stamp: "Formatted at 2026-08-09 19:01:03 on dist-test-slave-jq4t"
server_key: "7918f59809c55d3868be36e4e3c0395b"
server_key_iv: "4d11844696cad4d0450cb59db2b65b4c"
server_key_version: "encryptionkey@0"
I20260809 19:01:03.902570 25735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:03.906132 25735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:03.908087 25735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:03.908253 25735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:03.912698 25735 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43205
I20260809 19:01:03.912729 25833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43205 every 8 connection(s)
I20260809 19:01:03.913166 25735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:03.914311 25834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:03.914309 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25735
I20260809 19:01:03.914448 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:03.914664 24468 external_mini_cluster.cc:1428] Setting key 5332dfb223ef771242941ccec9ea1371
I20260809 19:01:03.917402 25839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:03.915269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53719 (local address 127.23.229.62:43205)
0809 19:01:03.915485 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:03.915495 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:03.915532 (+ 37us) server_negotiation.cc:407] Connection header received
0809 19:01:03.915992 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:03.916000 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:03.916026 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:03.916189 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:03.916973 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:03.916977 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:03.916978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:03.916982 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:03.917033 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:03.917044 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:03.917121 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:03.917192 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 19:01:03.917235 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
I20260809 19:01:03.917771 25834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d: Bootstrap starting.
I20260809 19:01:03.918431 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:03.918601 25834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:03.918902 25834 log.cc:824] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:03.919806 25834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d: No bootstrap required, opened a new log
I20260809 19:01:03.921283 25839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:03.920173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60301 (local address 127.23.229.62:43205)
0809 19:01:03.920236 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:03.920238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:03.920340 (+ 102us) server_negotiation.cc:407] Connection header received
0809 19:01:03.920415 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:03.920415 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:03.920420 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:03.920462 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:03.921057 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:03.921059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:03.921059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:03.921062 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:03.921076 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:03.921080 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:03.921125 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:03.921180 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 19:01:03.921191 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 19:01:03.922402 25834 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43205 } }
I20260809 19:01:03.922571 25834 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:03.922621 25834 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0e8454f23e843f39e6fd1bea0d4185d, State: Initialized, Role: FOLLOWER
I20260809 19:01:03.922746 25834 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43205 } }
I20260809 19:01:03.922855 25834 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:03.922902 25834 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:03.922955 25834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:03.923525 25834 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43205 } }
I20260809 19:01:03.923650 25834 leader_election.cc:302] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0e8454f23e843f39e6fd1bea0d4185d; no voters:
I20260809 19:01:03.923815 25834 leader_election.cc:288] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:03.923846 25848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:03.924022 25848 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [term 1 LEADER]: Becoming Leader. State: Replica: b0e8454f23e843f39e6fd1bea0d4185d, State: Running, Role: LEADER
I20260809 19:01:03.924084 25834 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:03.924155 25848 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43205 } }
I20260809 19:01:03.924579 25849 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43205 } } }
I20260809 19:01:03.924599 25850 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0e8454f23e843f39e6fd1bea0d4185d. Latest consensus state: current_term: 1 leader_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e8454f23e843f39e6fd1bea0d4185d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43205 } } }
I20260809 19:01:03.924719 25849 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:03.924723 25850 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:03.924988 25860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:03.925523 25860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:03.927248 25860 catalog_manager.cc:1347] Generated new cluster ID: 9d4ff176c6b74256b05ff56549a8d3fa
I20260809 19:01:03.927302 25860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:03.938453 25860 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:03.938655 25860 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:03.944963 25860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0e8454f23e843f39e6fd1bea0d4185d: Generated new TSK 0
I20260809 19:01:03.945158 25860 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:03.953111 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25735
2026-08-09T19:01:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1527 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:04 dist-test-slave-jq4t krb5kdc[25875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:04 dist-test-slave-jq4t krb5kdc[25875](info): set up 2 sockets
Aug 09 19:01:04 dist-test-slave-jq4t krb5kdc[25875](info): commencing operation
krb5kdc: starting...
W20260809 19:01:05.201561 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:05 dist-test-slave-jq4t krb5kdc[25875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:05.333189 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:35303
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:41073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:35303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:05.424410 25891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:05.424746 25891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:05.424790 25891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:05.425971 25891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:05.426046 25891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:05.426070 25891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:05.426090 25891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:05.426118 25891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:05.427695 25891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:41073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:35303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:35303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:05.428001 25891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:05.428254 25891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:05.433281 25897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:05.433269 25900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:05.433314 25898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:05.433665 25891 server_base.cc:1034] running on GCE node
I20260809 19:01:05.433993 25891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:05.434321 25891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:05.435552 25891 hybrid_clock.cc:648] HybridClock initialized: now 1786302065435531 us; error 43 us; skew 500 ppm
Aug 09 19:01:05 dist-test-slave-jq4t krb5kdc[25875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:05.438221 25891 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:05.438706 25891 webserver.cc:460] Webserver started at http://127.23.229.62:37783/ using document root <none> and password file <none>
I20260809 19:01:05.438977 25891 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:05.439049 25891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:05.439205 25891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:05.440279 25891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "180ce666085143bd97dab1e27b915ef6"
format_stamp: "Formatted at 2026-08-09 19:01:05 on dist-test-slave-jq4t"
server_key: "2f71accdd1bcb5f074fb568c25a01e71"
server_key_iv: "b2cd1b534e31aba65cb11cb76bcd3a07"
server_key_version: "encryptionkey@0"
I20260809 19:01:05.440677 25891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "180ce666085143bd97dab1e27b915ef6"
format_stamp: "Formatted at 2026-08-09 19:01:05 on dist-test-slave-jq4t"
server_key: "2f71accdd1bcb5f074fb568c25a01e71"
server_key_iv: "b2cd1b534e31aba65cb11cb76bcd3a07"
server_key_version: "encryptionkey@0"
I20260809 19:01:05.442148 25891 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:01:05.442961 25912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:05.443174 25891 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:01:05.443295 25891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "180ce666085143bd97dab1e27b915ef6"
format_stamp: "Formatted at 2026-08-09 19:01:05 on dist-test-slave-jq4t"
server_key: "2f71accdd1bcb5f074fb568c25a01e71"
server_key_iv: "b2cd1b534e31aba65cb11cb76bcd3a07"
server_key_version: "encryptionkey@0"
I20260809 19:01:05.443382 25891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:05.460464 25891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:05.462749 25891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:05.462944 25891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:05.467553 25891 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:35303
I20260809 19:01:05.467607 25988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:35303 every 8 connection(s)
I20260809 19:01:05.468036 25891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:05.469137 25990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:05.469367 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 25891
I20260809 19:01:05.469506 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:05.469740 24468 external_mini_cluster.cc:1428] Setting key 055b86e7fb969fda5ed17ca60f8a345b
I20260809 19:01:05.472997 25990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6: Bootstrap starting.
I20260809 19:01:05.473742 25990 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:05.474057 25990 log.cc:824] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:05.474893 25990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6: No bootstrap required, opened a new log
Aug 09 19:01:05 dist-test-slave-jq4t krb5kdc[25875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:05.477162 25990 raft_consensus.cc:348] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180ce666085143bd97dab1e27b915ef6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35303 } }
I20260809 19:01:05.477325 25990 raft_consensus.cc:374] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:05.477375 25990 raft_consensus.cc:729] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 180ce666085143bd97dab1e27b915ef6, State: Initialized, Role: FOLLOWER
I20260809 19:01:05.477571 25990 consensus_queue.cc:260] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180ce666085143bd97dab1e27b915ef6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35303 } }
I20260809 19:01:05.477674 25990 raft_consensus.cc:388] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:05.477711 25990 raft_consensus.cc:482] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:05.477769 25990 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:05.478574 25990 raft_consensus.cc:504] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180ce666085143bd97dab1e27b915ef6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35303 } }
I20260809 19:01:05.478708 25990 leader_election.cc:302] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 180ce666085143bd97dab1e27b915ef6; no voters:
I20260809 19:01:05.478891 25990 leader_election.cc:288] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:05.478948 25996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:05.479171 25990 sys_catalog.cc:564] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:05.479167 25996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [term 1 LEADER]: Becoming Leader. State: Replica: 180ce666085143bd97dab1e27b915ef6, State: Running, Role: LEADER
I20260809 19:01:05.479396 25996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180ce666085143bd97dab1e27b915ef6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35303 } }
I20260809 19:01:05.479856 25998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "180ce666085143bd97dab1e27b915ef6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180ce666085143bd97dab1e27b915ef6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35303 } } }
I20260809 19:01:05.479991 25998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:05.480484 25999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 180ce666085143bd97dab1e27b915ef6. Latest consensus state: current_term: 1 leader_uuid: "180ce666085143bd97dab1e27b915ef6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180ce666085143bd97dab1e27b915ef6" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 35303 } } }
I20260809 19:01:05.480639 25999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:05.480561 26010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:05.481374 26010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:05.481715 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:05.470355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48837 (local address 127.23.229.62:35303)
0809 19:01:05.470582 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:05.470593 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:05.470632 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:01:05.471146 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:05.471157 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:05.471227 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:05.471393 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:05.472005 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:05.473456 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:05.474285 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:05.474837 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:05.474963 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:05.477484 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:05.477489 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:05.477490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:05.477502 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:05.479664 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:05.480177 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:05.480180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:05.480181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:05.480297 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:05.480607 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:05.480608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:05.480608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:05.480984 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:05.481172 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:05.481306 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 19:01:05.481560 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":108,"threads_started":1}
I20260809 19:01:05.482815 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:05.483201 26010 catalog_manager.cc:1347] Generated new cluster ID: 00274f1a6a494f24a191b461107e37cf
I20260809 19:01:05.483289 26010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:05.490947 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:05.484398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44603 (local address 127.23.229.62:35303)
0809 19:01:05.484452 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:05.484453 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:05.484583 (+ 130us) server_negotiation.cc:407] Connection header received
0809 19:01:05.484658 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:05.484659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:05.484669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:05.484725 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:05.485270 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:05.485763 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:05.486494 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:05.486731 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:05.486815 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:05.488125 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:05.488130 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:05.488130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:05.488137 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:05.489685 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:05.490080 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:05.490081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:05.490081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:05.490146 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:05.490366 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:05.490367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:05.490367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:05.490490 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:05.490598 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:05.490710 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 19:01:05.490810 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 19:01:05.492779 26010 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:05.493324 26010 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:05.496707 26010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 180ce666085143bd97dab1e27b915ef6: Generated new TSK 0
I20260809 19:01:05.496937 26010 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:05.499152 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 25891
2026-08-09T19:01:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1554 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:05 dist-test-slave-jq4t krb5kdc[26027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:05 dist-test-slave-jq4t krb5kdc[26027](info): set up 2 sockets
Aug 09 19:01:05 dist-test-slave-jq4t krb5kdc[26027](info): commencing operation
krb5kdc: starting...
W20260809 19:01:06.793373 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:06 dist-test-slave-jq4t krb5kdc[26027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:06.921725 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:34741
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:38437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:34741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:07.008450 26044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:07.008772 26044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:07.008800 26044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:07.009987 26044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:07.010028 26044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:07.010043 26044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:07.010056 26044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:07.010067 26044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:07.011620 26044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:38437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:34741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:34741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:07.011847 26044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:07.012039 26044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:07.017381 26051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:07.017376 26050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:07.017373 26055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:07.017671 26044 server_base.cc:1034] running on GCE node
I20260809 19:01:07.017938 26044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:07.018245 26044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:07.019418 26044 hybrid_clock.cc:648] HybridClock initialized: now 1786302067019395 us; error 33 us; skew 500 ppm
Aug 09 19:01:07 dist-test-slave-jq4t krb5kdc[26027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302067, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:07.022207 26044 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:07.022696 26044 webserver.cc:460] Webserver started at http://127.23.229.62:43675/ using document root <none> and password file <none>
I20260809 19:01:07.022925 26044 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:07.022967 26044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:07.023061 26044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:07.024107 26044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "1144c8c0d63a4d0c82d0ed99437e3e75"
format_stamp: "Formatted at 2026-08-09 19:01:07 on dist-test-slave-jq4t"
server_key: "68982f7a158d5ea6b95f4122418117a7"
server_key_iv: "a0285a64d2ea035f1e54feae1df84838"
server_key_version: "encryptionkey@0"
I20260809 19:01:07.024432 26044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "1144c8c0d63a4d0c82d0ed99437e3e75"
format_stamp: "Formatted at 2026-08-09 19:01:07 on dist-test-slave-jq4t"
server_key: "68982f7a158d5ea6b95f4122418117a7"
server_key_iv: "a0285a64d2ea035f1e54feae1df84838"
server_key_version: "encryptionkey@0"
I20260809 19:01:07.025933 26044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:01:07.026717 26063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:07.026995 26044 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:01:07.027123 26044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "1144c8c0d63a4d0c82d0ed99437e3e75"
format_stamp: "Formatted at 2026-08-09 19:01:07 on dist-test-slave-jq4t"
server_key: "68982f7a158d5ea6b95f4122418117a7"
server_key_iv: "a0285a64d2ea035f1e54feae1df84838"
server_key_version: "encryptionkey@0"
I20260809 19:01:07.027210 26044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:07.043081 26044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:07.045746 26044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:07.045961 26044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:07.050523 26044 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:34741
I20260809 19:01:07.050560 26138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:34741 every 8 connection(s)
I20260809 19:01:07.050997 26044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:07.051999 26139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:07.054494 26139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75: Bootstrap starting.
I20260809 19:01:07.055183 26139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:07.055501 26139 log.cc:824] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:07.056329 26139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75: No bootstrap required, opened a new log
I20260809 19:01:07.057782 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26044
I20260809 19:01:07.057910 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:07.058087 24468 external_mini_cluster.cc:1428] Setting key 42b205503fa7748c93756b086bab3d8d
I20260809 19:01:07.058475 26139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34741 } }
I20260809 19:01:07.058702 26139 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:07.058809 26139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1144c8c0d63a4d0c82d0ed99437e3e75, State: Initialized, Role: FOLLOWER
I20260809 19:01:07.058987 26139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34741 } }
I20260809 19:01:07.059082 26139 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:07.059106 26139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:07.059176 26139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:07.059885 26139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34741 } }
I20260809 19:01:07.059980 26139 leader_election.cc:302] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1144c8c0d63a4d0c82d0ed99437e3e75; no voters:
I20260809 19:01:07.060185 26139 leader_election.cc:288] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:07.060231 26148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:07.060406 26148 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [term 1 LEADER]: Becoming Leader. State: Replica: 1144c8c0d63a4d0c82d0ed99437e3e75, State: Running, Role: LEADER
I20260809 19:01:07.060514 26139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:07.060576 26148 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34741 } }
I20260809 19:01:07.060927 26148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1144c8c0d63a4d0c82d0ed99437e3e75. Latest consensus state: current_term: 1 leader_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34741 } } }
I20260809 19:01:07.061012 26148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:07.061301 26151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144c8c0d63a4d0c82d0ed99437e3e75" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 34741 } } }
I20260809 19:01:07.061421 26151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:07.061923 26164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:07.062479 26164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:07.064679 26164 catalog_manager.cc:1347] Generated new cluster ID: 9249483089594ef3b3f236a60c78267e
I20260809 19:01:07.064744 26164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:07.065685 26147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.058685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36145 (local address 127.23.229.62:34741)
0809 19:01:07.058919 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.058931 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.058970 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:01:07.059122 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.059130 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.059190 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.059330 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:07.059660 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.061922 (+ 2262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.063177 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.063732 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.063850 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.064790 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:07.064794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:07.064795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:07.065010 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:07.065055 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:07.065070 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:07.065127 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.065397 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.065464 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":104,"threads_started":1}
I20260809 19:01:07.069547 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:07.074738 26147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.071124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42445 (local address 127.23.229.62:34741)
0809 19:01:07.071159 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.071161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.071271 (+ 110us) server_negotiation.cc:407] Connection header received
0809 19:01:07.071330 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.071330 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.071341 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.071393 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:07.071539 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.072259 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.073342 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.073658 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.073714 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.074467 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:07.074469 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:07.074469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:07.074474 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:07.074490 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:07.074495 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:07.074552 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.074624 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.074652 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":15}
I20260809 19:01:07.076869 26164 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:07.077591 26164 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:07.082479 26164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1144c8c0d63a4d0c82d0ed99437e3e75: Generated new TSK 0
I20260809 19:01:07.082671 26164 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:07.089525 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26044
2026-08-09T19:01:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:07 dist-test-slave-jq4t krb5kdc[26189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:07 dist-test-slave-jq4t krb5kdc[26189](info): set up 2 sockets
Aug 09 19:01:07 dist-test-slave-jq4t krb5kdc[26189](info): commencing operation
krb5kdc: starting...
W20260809 19:01:08.337713 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:08 dist-test-slave-jq4t krb5kdc[26189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:08.465214 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43829
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:35359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:43829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:08.549767 26210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:08.549989 26210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:08.550014 26210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:08.551134 26210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:08.551173 26210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:08.551188 26210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:08.551200 26210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:08.551213 26210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:08.552700 26210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:35359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:43829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:43829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:08.552909 26210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:08.553081 26210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:08.557979 26218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:08.557953 26220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:08.558032 26210 server_base.cc:1034] running on GCE node
W20260809 19:01:08.557953 26217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:08.558545 26210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:08.558851 26210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:08.560043 26210 hybrid_clock.cc:648] HybridClock initialized: now 1786302068560036 us; error 41 us; skew 500 ppm
Aug 09 19:01:08 dist-test-slave-jq4t krb5kdc[26189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302068, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:08.567364 26210 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:08.567842 26210 webserver.cc:460] Webserver started at http://127.23.229.62:37033/ using document root <none> and password file <none>
I20260809 19:01:08.568097 26210 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:08.568174 26210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:08.568325 26210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:08.569581 26210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "d3cf70e072324ed4a8e9825fc63f010a"
format_stamp: "Formatted at 2026-08-09 19:01:08 on dist-test-slave-jq4t"
server_key: "801814467132a91b94b19ee19affe513"
server_key_iv: "ce9a945dafd05e17318f83977ae8b74b"
server_key_version: "encryptionkey@0"
I20260809 19:01:08.569994 26210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "d3cf70e072324ed4a8e9825fc63f010a"
format_stamp: "Formatted at 2026-08-09 19:01:08 on dist-test-slave-jq4t"
server_key: "801814467132a91b94b19ee19affe513"
server_key_iv: "ce9a945dafd05e17318f83977ae8b74b"
server_key_version: "encryptionkey@0"
I20260809 19:01:08.571422 26210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:01:08.572176 26229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:08.572355 26210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 19:01:08.572513 26210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "d3cf70e072324ed4a8e9825fc63f010a"
format_stamp: "Formatted at 2026-08-09 19:01:08 on dist-test-slave-jq4t"
server_key: "801814467132a91b94b19ee19affe513"
server_key_iv: "ce9a945dafd05e17318f83977ae8b74b"
server_key_version: "encryptionkey@0"
I20260809 19:01:08.572603 26210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:08.575929 26210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:08.578331 26210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:08.578495 26210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:08.582652 26210 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:43829
I20260809 19:01:08.582684 26320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:43829 every 8 connection(s)
I20260809 19:01:08.583015 26210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:08.584013 26322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:08.587026 26322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a: Bootstrap starting.
I20260809 19:01:08.587657 26322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:08.587965 26322 log.cc:824] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:08.588804 26322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a: No bootstrap required, opened a new log
I20260809 19:01:08.590148 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26210
I20260809 19:01:08.590304 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:08.590498 24468 external_mini_cluster.cc:1428] Setting key aa323e6c5b188331be9bb4cbb0d5cf39
I20260809 19:01:08.590659 26322 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cf70e072324ed4a8e9825fc63f010a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43829 } }
I20260809 19:01:08.590847 26322 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:08.590917 26322 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cf70e072324ed4a8e9825fc63f010a, State: Initialized, Role: FOLLOWER
I20260809 19:01:08.591148 26322 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cf70e072324ed4a8e9825fc63f010a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43829 } }
I20260809 19:01:08.591323 26322 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:08.591392 26322 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:08.591454 26322 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:08.592630 26322 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cf70e072324ed4a8e9825fc63f010a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43829 } }
I20260809 19:01:08.592757 26322 leader_election.cc:302] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3cf70e072324ed4a8e9825fc63f010a; no voters:
I20260809 19:01:08.592932 26322 leader_election.cc:288] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:08.592978 26329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:08.593156 26329 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [term 1 LEADER]: Becoming Leader. State: Replica: d3cf70e072324ed4a8e9825fc63f010a, State: Running, Role: LEADER
I20260809 19:01:08.593230 26322 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:08.593305 26329 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cf70e072324ed4a8e9825fc63f010a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43829 } }
I20260809 19:01:08.593705 26331 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3cf70e072324ed4a8e9825fc63f010a. Latest consensus state: current_term: 1 leader_uuid: "d3cf70e072324ed4a8e9825fc63f010a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cf70e072324ed4a8e9825fc63f010a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43829 } } }
I20260809 19:01:08.593134 26327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:08.591107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51643 (local address 127.23.229.62:43829)
0809 19:01:08.591327 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:08.591334 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:08.591366 (+ 32us) server_negotiation.cc:407] Connection header received
0809 19:01:08.591514 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:08.591522 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:08.591553 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:08.591704 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:08.592474 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:08.592505 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:08.592505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:08.592509 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:08.592558 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:08.592573 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:08.592661 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:08.592733 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 19:01:08.592869 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":102,"threads_started":1}
I20260809 19:01:08.593715 26330 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3cf70e072324ed4a8e9825fc63f010a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cf70e072324ed4a8e9825fc63f010a" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 43829 } } }
I20260809 19:01:08.593832 26331 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:08.594292 26330 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:08.594494 26343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:08.595268 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:08.595319 26343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:08.596982 26343 catalog_manager.cc:1347] Generated new cluster ID: f2cf25aafcf54b67ad71c940f960c171
I20260809 19:01:08.597040 26343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:08.598318 26327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:08.597161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51039 (local address 127.23.229.62:43829)
0809 19:01:08.597198 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:08.597200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:08.597304 (+ 104us) server_negotiation.cc:407] Connection header received
0809 19:01:08.597371 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:08.597372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:08.597384 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:08.597430 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:08.598079 (+ 649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:08.598080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:08.598080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:08.598084 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:08.598099 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:08.598103 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:08.598152 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:08.598215 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 19:01:08.598232 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 19:01:08.618001 26343 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:08.618211 26343 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:08.632692 26343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3cf70e072324ed4a8e9825fc63f010a: Generated new TSK 0
I20260809 19:01:08.632980 26343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:08.645483 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26210
2026-08-09T19:01:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1565 ms)
[----------] 18 tests from AuthTokenIssuingTest (28038 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:08 dist-test-slave-jq4t krb5kdc[26380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:08 dist-test-slave-jq4t krb5kdc[26380](info): set up 2 sockets
Aug 09 19:01:08 dist-test-slave-jq4t krb5kdc[26380](info): commencing operation
krb5kdc: starting...
W20260809 19:01:09.893406 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:09 dist-test-slave-jq4t krb5kdc[26380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:10.021744 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42303
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42303,127.23.229.61:41733,127.23.229.60:34573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:10.108052 26398 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:01:10.108290 26398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:10.108310 26398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:10.108332 26398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:10.109555 26398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:10.109604 26398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:10.109619 26398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:10.109632 26398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:10.109645 26398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:10.111202 26398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42303,127.23.229.61:41733,127.23.229.60:34573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:42303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:10.111424 26398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:10.111610 26398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:10.116720 26408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:10.116734 26410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:10.116717 26407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:10.117086 26398 server_base.cc:1034] running on GCE node
I20260809 19:01:10.117403 26398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:10.117759 26398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:10.118944 26398 hybrid_clock.cc:648] HybridClock initialized: now 1786302070118926 us; error 46 us; skew 500 ppm
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:10.121589 26398 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:10.122063 26398 webserver.cc:460] Webserver started at http://127.23.229.62:44809/ using document root <none> and password file <none>
I20260809 19:01:10.122309 26398 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:10.122381 26398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:10.122553 26398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:10.123678 26398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "3b3d6857a6354a7caf3062d16466b8f5"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "c9ba5fb57815c0a221db34fb697028da"
server_key_iv: "af2f70503725fcf68bfa19b79ac36caa"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.124092 26398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "3b3d6857a6354a7caf3062d16466b8f5"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "c9ba5fb57815c0a221db34fb697028da"
server_key_iv: "af2f70503725fcf68bfa19b79ac36caa"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.125556 26398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:01:10.126430 26421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:10.126659 26398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:01:10.126775 26398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "3b3d6857a6354a7caf3062d16466b8f5"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "c9ba5fb57815c0a221db34fb697028da"
server_key_iv: "af2f70503725fcf68bfa19b79ac36caa"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.126879 26398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:10.135066 26398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:10.137387 26398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:10.137583 26398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:10.141850 26398 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:42303
I20260809 19:01:10.141947 26496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:42303 every 8 connection(s)
I20260809 19:01:10.142321 26398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:10.143420 26498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:10.145188 26498 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:10.147989 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26398
I20260809 19:01:10.148123 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:10.148320 24468 external_mini_cluster.cc:1428] Setting key e390759f523fea880bf11ed1435a02f0
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:10.156457 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.146013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42303 (local address 127.0.0.1:48996)
0809 19:01:10.146217 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.146265 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.146802 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.147128 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.147130 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.147452 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.147608 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.147612 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.149209 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.149211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.149905 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.149907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.150483 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.150485 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.150553 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.151171 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.151179 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.152635 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.154911 (+ 2276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.154918 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.154920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.155127 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.155424 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.155425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.155425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.155513 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.155996 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.156001 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.156062 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.156138 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.156279 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":99,"threads_started":1}
I20260809 19:01:10.156518 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.145994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48996 (local address 127.23.229.62:42303)
0809 19:01:10.146228 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.146238 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.146370 (+ 132us) server_negotiation.cc:407] Connection header received
0809 19:01:10.146992 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.146994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.147011 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.147108 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.147714 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.149100 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.150026 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.150344 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.150484 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.152726 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.152736 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.152737 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.152746 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.154806 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.155222 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.155226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.155227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.155345 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.155583 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.155584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.155585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.155919 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.156019 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.156214 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.156368 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":166,"spinlock_wait_cycles":9088,"thread_start_us":115,"threads_started":1}
I20260809 19:01:10.157455 26498 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:10.157791 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.157692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38758)
0809 19:01:10.157728 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.157771 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.23.229.61@KRBTEST.COM; defaulting to no policy
W20260809 19:01:10.157985 26423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
I20260809 19:01:10.158522 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.158404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38760)
0809 19:01:10.158471 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.158502 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 19:01:10.158703 26498 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:41733: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab.
Entry for principal kudu/127.23.229.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab.
I20260809 19:01:10.175477 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:41733
--webserver_interface=127.23.229.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab
--principal=kudu/127.23.229.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42303,127.23.229.61:41733,127.23.229.60:34573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:01:10.207949 26498 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } attempt: 1
I20260809 19:01:10.208561 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.208372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38776)
0809 19:01:10.208448 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.208519 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 19:01:10.208966 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.208858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38784)
0809 19:01:10.208914 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.208945 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:01:10.209096 26498 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:41733: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
W20260809 19:01:10.260689 26508 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:01:10.260896 26508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:10.260913 26508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:10.260933 26508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:10.262108 26508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:10.262152 26508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:10.262166 26508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:10.262179 26508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:10.262192 26508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:10.263686 26508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42303,127.23.229.61:41733,127.23.229.60:34573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab
--principal=kudu/127.23.229.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:41733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.229.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:10.263962 26508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:10.264204 26508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:10.269209 26521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:10.269230 26519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:10.269209 26524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:10.269495 26508 server_base.cc:1034] running on GCE node
I20260809 19:01:10.269743 26508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:10.269999 26508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:10.271173 26508 hybrid_clock.cc:648] HybridClock initialized: now 1786302070271163 us; error 41 us; skew 500 ppm
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:10.273747 26508 init.cc:377] Logged in from keytab as kudu/127.23.229.61@KRBTEST.COM (short username kudu)
I20260809 19:01:10.274247 26508 webserver.cc:460] Webserver started at http://127.23.229.61:43089/ using document root <none> and password file <none>
I20260809 19:01:10.274479 26508 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:10.274546 26508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:10.274712 26508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:10.275784 26508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data/instance:
uuid: "58cb1608eca54e17bbff6c64cb0f1288"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "7a9b9afa9e0d77048c9f4b40ce73e4cb"
server_key_iv: "75d82e9597d366bfbf476a33af269294"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.276170 26508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/wal/instance:
uuid: "58cb1608eca54e17bbff6c64cb0f1288"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "7a9b9afa9e0d77048c9f4b40ce73e4cb"
server_key_iv: "75d82e9597d366bfbf476a33af269294"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.277266 26498 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } attempt: 2
I20260809 19:01:10.277679 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.277537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38792)
0809 19:01:10.277606 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.277648 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 19:01:10.277705 26508 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 19:01:10.278061 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.277953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38796)
0809 19:01:10.278004 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.278030 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 19:01:10.278155 26498 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:41733: Network error: Client connection negotiation failed: client connection to 127.23.229.61:41733: connect: Connection refused (error 111)
I20260809 19:01:10.278653 26533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:10.278823 26508 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 19:01:10.278926 26508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/wal
uuid: "58cb1608eca54e17bbff6c64cb0f1288"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "7a9b9afa9e0d77048c9f4b40ce73e4cb"
server_key_iv: "75d82e9597d366bfbf476a33af269294"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.279019 26508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:10.288848 26508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:10.291325 26508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:10.291522 26508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:10.295660 26508 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.61:41733
I20260809 19:01:10.295711 26612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.61:41733 every 8 connection(s)
I20260809 19:01:10.296092 26508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
I20260809 19:01:10.297245 26613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:10.298941 26613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:10.300956 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26508
I20260809 19:01:10.301070 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-1/wal/instance
I20260809 19:01:10.301255 24468 external_mini_cluster.cc:1428] Setting key 50b1b0d0b4275d2ea6b5616ae459cee1
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:10.309469 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.299771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49010 (local address 127.23.229.62:42303)
0809 19:01:10.299891 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.299893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.300066 (+ 173us) server_negotiation.cc:407] Connection header received
0809 19:01:10.300645 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.300646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.300659 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.300721 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.301466 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.301967 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.303183 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.303409 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.303479 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.306141 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.306142 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.306143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.306153 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.307922 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.308352 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.308353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.308354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.308427 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.308717 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.308718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.308719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.308879 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.308955 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.309233 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.309342 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 19:01:10.309491 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.299675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42303 (local address 127.0.0.1:49010)
0809 19:01:10.299928 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.299974 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.300526 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.300805 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.300811 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.301098 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.301361 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.301367 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.302069 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.302071 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.303082 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.303086 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.303527 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.303529 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.303696 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.304249 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.304257 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.306035 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.308023 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.308031 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.308033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.308263 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.308522 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.308523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.308524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.308642 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.308954 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.308960 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.309090 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.309179 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.309311 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":115,"threads_started":1}
I20260809 19:01:10.310163 26613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.23.229.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.60@KRBTEST.COM" created.
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:10.318216 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.310477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38806)
0809 19:01:10.310544 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.310558 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.310621 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.310842 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.310843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.310991 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.311051 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.311053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.311990 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.311991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.312640 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.312642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.313227 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.313228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.313288 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.313643 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.313647 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.314928 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.317104 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.317105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.317105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.317274 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.317511 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.317512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.317512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.317567 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.317892 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.317892 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.317932 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.317992 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.318097 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 19:01:10.318279 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.310517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38806 (local address 127.23.229.61:41733)
0809 19:01:10.310674 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.310678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.310697 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:01:10.310727 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.310728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.310740 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.310817 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.311130 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.311891 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.312712 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.313132 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.313205 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.315015 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.315024 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.315025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.315032 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.317034 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.317376 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.317380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.317380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.317442 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.317649 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.317650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.317650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.317802 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.317911 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.318032 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.318150 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260809 19:01:10.318924 26613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:10.319319 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.319192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56374)
0809 19:01:10.319243 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.319288 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 19:01:10.319530 26534 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
I20260809 19:01:10.320067 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.319957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56386)
0809 19:01:10.320013 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.320044 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 19:01:10.320212 26613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:34573: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab.
Entry for principal kudu/127.23.229.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab.
I20260809 19:01:10.329936 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:34573
--webserver_interface=127.23.229.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab
--principal=kudu/127.23.229.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:42303,127.23.229.61:41733,127.23.229.60:34573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:01:10.369335 26498 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } attempt: 3
I20260809 19:01:10.369491 26613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } attempt: 1
I20260809 19:01:10.369939 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.369772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56398)
0809 19:01:10.369835 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.369891 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 19:01:10.370376 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.370290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56412)
0809 19:01:10.370317 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.370345 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260809 19:01:10.370572 26613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:34573: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:10.377283 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.369789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38820)
0809 19:01:10.369870 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.369882 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.369940 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.370272 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.370273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.370484 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.370573 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.370575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.371593 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.371594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.372185 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.372187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.372736 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.372737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.372805 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.373338 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.373343 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.374585 (+ 1242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.376181 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.376182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.376183 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.376368 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.376575 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.376576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.376576 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.376641 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.376924 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.376926 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.376978 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.377065 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.377178 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 19:01:10.377279 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.370066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38820 (local address 127.23.229.61:41733)
0809 19:01:10.370112 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.370114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.370124 (+ 10us) server_negotiation.cc:407] Connection header received
0809 19:01:10.370153 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.370154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.370173 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.370252 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.370683 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.371497 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.372287 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.372661 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.372736 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.374686 (+ 1950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.374687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.374688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.374695 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.376089 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.376444 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.376445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.376446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.376522 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.376709 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.376710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.376710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.376842 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.376922 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.377094 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.377178 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 19:01:10.377681 26498 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:10.378093 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.377986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56416)
0809 19:01:10.378039 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.378070 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 19:01:10.378471 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.378379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56430)
0809 19:01:10.378426 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.378450 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 19:01:10.378569 26498 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:34573: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
I20260809 19:01:10.409744 26498 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } attempt: 1
I20260809 19:01:10.410336 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.410171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56438)
0809 19:01:10.410266 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.410302 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 19:01:10.410728 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.410627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56444)
0809 19:01:10.410676 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.410702 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 19:01:10.410837 26498 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:34573: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
W20260809 19:01:10.421438 26624 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:01:10.421671 26624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:10.421689 26624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:10.421711 26624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:10.422892 26624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:10.422937 26624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:10.422952 26624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:10.422971 26624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:10.422983 26624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:10.424592 26624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:42303,127.23.229.61:41733,127.23.229.60:34573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab
--principal=kudu/127.23.229.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:34573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.229.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:10.424861 26624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:10.425118 26624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:10.430560 26637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:10.430537 26634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:10.430766 26624 server_base.cc:1034] running on GCE node
W20260809 19:01:10.430848 26633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:10.431156 26624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:10.431478 26624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:10.432624 26624 hybrid_clock.cc:648] HybridClock initialized: now 1786302070432611 us; error 31 us; skew 500 ppm
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:10.435196 26624 init.cc:377] Logged in from keytab as kudu/127.23.229.60@KRBTEST.COM (short username kudu)
I20260809 19:01:10.435660 26624 webserver.cc:460] Webserver started at http://127.23.229.60:34781/ using document root <none> and password file <none>
I20260809 19:01:10.435900 26624 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:10.435969 26624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:10.436129 26624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:10.437304 26624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data/instance:
uuid: "f53a3e9a70954fd4afec9881c8684b88"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "93da8c8c3019c4756c049e49d0d58993"
server_key_iv: "c8c7d1457a0ec0b31bb0d48be52a28a5"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.437705 26624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/wal/instance:
uuid: "f53a3e9a70954fd4afec9881c8684b88"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "93da8c8c3019c4756c049e49d0d58993"
server_key_iv: "c8c7d1457a0ec0b31bb0d48be52a28a5"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.438760 26613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } attempt: 2
I20260809 19:01:10.439174 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.439035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56460)
0809 19:01:10.439102 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.439133 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 19:01:10.439200 26624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 19:01:10.439608 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.439527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56470)
0809 19:01:10.439568 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.439592 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 19:01:10.439723 26613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:34573: Network error: Client connection negotiation failed: client connection to 127.23.229.60:34573: connect: Connection refused (error 111)
I20260809 19:01:10.440176 26646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:10.440375 26624 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 19:01:10.440513 26624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/wal
uuid: "f53a3e9a70954fd4afec9881c8684b88"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-jq4t"
server_key: "93da8c8c3019c4756c049e49d0d58993"
server_key_iv: "c8c7d1457a0ec0b31bb0d48be52a28a5"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.440606 26624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:10.452133 26624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:10.454638 26624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:10.454815 26624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:10.459230 26624 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.60:34573
I20260809 19:01:10.459268 26738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.60:34573 every 8 connection(s)
I20260809 19:01:10.459663 26624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
I20260809 19:01:10.460834 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:10.462433 26739 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:10.466187 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26624
I20260809 19:01:10.466296 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301787754163-24468-0/minicluster-data/master-2/wal/instance
I20260809 19:01:10.466498 24468 external_mini_cluster.cc:1428] Setting key b9f0a6a61a33ee5f462eb463faffa3b9
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:10.472465 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.463184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49020 (local address 127.23.229.62:42303)
0809 19:01:10.463265 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.463267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.463493 (+ 226us) server_negotiation.cc:407] Connection header received
0809 19:01:10.463938 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.463939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.463949 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.464019 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.464644 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.465131 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.466104 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.466421 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.466503 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.469430 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.469432 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.469432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.469442 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.470937 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.471459 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.471460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.471461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.471523 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.471766 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.471767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.471768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.471926 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.472009 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.472256 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.472352 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:01:10.472611 26741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.463162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:42303 (local address 127.0.0.1:49020)
0809 19:01:10.463345 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.463398 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.463853 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.464072 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.464075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.464332 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.464564 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.464568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.465213 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.465214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.466012 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.466014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.466521 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.466522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.466679 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.467328 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.467344 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.469313 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.471027 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.471033 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.471035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.471383 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.471596 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.471596 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.471596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.471700 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.472000 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.472005 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.472122 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.472207 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.472332 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 19:01:10.473227 26739 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:10.476951 26743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.466961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56482 (local address 127.23.229.60:34573)
0809 19:01:10.467221 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.467226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.467254 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:01:10.467302 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.467304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.467325 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.467389 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.468195 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.469321 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.470401 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.470698 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.470754 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.473639 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.473648 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.473648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.473655 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.475549 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.475958 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.475961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.475962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.476047 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.476264 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.476265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.476265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.476468 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.476672 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.476720 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.476794 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":93,"threads_started":1}
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:10.480772 26741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.473534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:41733 (local address 127.0.0.1:38830)
0809 19:01:10.473589 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.473602 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.473638 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.473749 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.473751 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.473917 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.473978 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.473980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.474761 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.474762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.475560 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.475561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.476047 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.476049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.476132 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.476461 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.476466 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.478034 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.479711 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.479712 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.479712 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.479886 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.480100 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.480101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.480102 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.480159 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.480429 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.480430 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.480472 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.480582 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.480678 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 19:01:10.480772 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.473597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38830 (local address 127.23.229.61:41733)
0809 19:01:10.473643 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.473645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.473657 (+ 12us) server_negotiation.cc:407] Connection header received
0809 19:01:10.473692 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.473693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.473702 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.473746 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.474058 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.474672 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.475643 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.475971 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.476031 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.478125 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.478127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.478127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.478134 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.479606 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.479965 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.479966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.479967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.480023 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.480233 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.480233 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.480234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.480353 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.480424 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.480609 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.480681 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 19:01:10.481330 26739 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:10.485076 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.477753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49028 (local address 127.23.229.62:42303)
0809 19:01:10.477794 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.477795 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.477804 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:01:10.477850 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.477851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.477860 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.477923 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.478362 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.478825 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.479500 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.479702 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.479775 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.482148 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.482149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.482149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.482155 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.483755 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.484195 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.484197 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.484197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.484269 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.484505 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.484507 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.484507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.484644 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.484840 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.484885 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.484981 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 19:01:10.485989 26498 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } attempt: 2
I20260809 19:01:10.488780 26741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.481620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56484)
0809 19:01:10.481665 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.481674 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.481709 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.481845 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.481845 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.481955 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.481985 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.481986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.482680 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.482681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.483482 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.483485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.483870 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.483871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.483918 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.484266 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.484272 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.485684 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.487616 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.487617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.487618 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.487834 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.488042 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.488042 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.488043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.488109 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.488404 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.488405 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.488437 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.488545 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.488646 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 19:01:10.488866 26743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.481675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56484 (local address 127.23.229.60:34573)
0809 19:01:10.481720 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.481723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.481732 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:01:10.481770 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.481770 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.481781 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.481837 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.482069 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.482620 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.483571 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.483771 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.483861 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.485792 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.485793 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.485793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.485799 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.487546 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.487908 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.487909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.487909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.487971 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.488180 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.488181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.488181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.488312 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.488375 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.488589 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.488713 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":24}
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:10.491295 26739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: Bootstrap starting.
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 19:01:10.492157 26739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:10.492594 26739 log.cc:824] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:10.493599 26739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: No bootstrap required, opened a new log
I20260809 19:01:10.495177 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.486221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56492)
0809 19:01:10.486264 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.486273 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.486330 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.486713 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.486714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.486878 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.486930 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.486931 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.487854 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.487855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.488685 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.488688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.489818 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.489819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.489880 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.490276 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.490281 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.491985 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.493971 (+ 1986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.493972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.493973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.494194 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.494408 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.494409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.494409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.494479 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.494816 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.494817 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.494869 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.494960 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.495077 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 19:01:10.495217 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.486359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56492 (local address 127.23.229.60:34573)
0809 19:01:10.486551 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.486553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.486561 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:01:10.486582 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.486582 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.486593 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.486696 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.487010 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.487765 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.488771 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.489666 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.489755 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.492071 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.492072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.492072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.492078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.493873 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.494277 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.494278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.494279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.494337 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.494555 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.494556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.494556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.494756 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.494824 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.494990 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.495083 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":122,"threads_started":1}
I20260809 19:01:10.495783 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.485763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38838 (local address 127.23.229.61:41733)
0809 19:01:10.485808 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.485810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.485910 (+ 100us) server_negotiation.cc:407] Connection header received
0809 19:01:10.485974 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.485975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.485985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.486033 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.486946 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.487434 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.488387 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.488736 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.488804 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.492645 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.492647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.492647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.492656 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.494315 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.494778 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.494780 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.494780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.494846 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.495073 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.495075 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.495076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.495217 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.495372 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.495629 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.495709 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 19:01:10.496009 26739 raft_consensus.cc:348] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.496207 26739 raft_consensus.cc:729] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f53a3e9a70954fd4afec9881c8684b88, State: Initialized, Role: FOLLOWER
I20260809 19:01:10.496346 26739 consensus_queue.cc:260] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.496781 26739 sys_catalog.cc:564] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:10.496727 26748 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.497057 26748 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:10.497275 26498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5: Bootstrap starting.
I20260809 19:01:10.497957 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:10.498165 26498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:10.498517 26498 log.cc:824] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5: Log is configured to *not* fsync() on all Append() calls
W20260809 19:01:10.498941 26767 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:01:10.499032 26767 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:01:10.499452 26498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5: No bootstrap required, opened a new log
I20260809 19:01:10.499110 26459 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3b3d6857a6354a7caf3062d16466b8f5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49028
I20260809 19:01:10.501375 26498 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.501703 26498 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b3d6857a6354a7caf3062d16466b8f5, State: Initialized, Role: FOLLOWER
I20260809 19:01:10.501849 26498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.502274 26498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:10.502329 26459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 19:01:10.502261 26770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.502432 26459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:10.502430 26770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:10.500646 26624 master_runner.cc:186] Error getting master registration for 127.23.229.62:42303: OK, instance_id { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" instance_seqno: 1786302070140636 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:01:10.503121 26624 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:01:10.503278 26459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.503502 26459 leader_election.cc:288] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 58cb1608eca54e17bbff6c64cb0f1288 (127.23.229.61:41733), f53a3e9a70954fd4afec9881c8684b88 (127.23.229.60:34573)
I20260809 19:01:10.503780 26689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b3d6857a6354a7caf3062d16466b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f53a3e9a70954fd4afec9881c8684b88"
I20260809 19:01:10.503895 26689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:10.504904 26689 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3d6857a6354a7caf3062d16466b8f5 in term 1.
I20260809 19:01:10.505170 26422 leader_election.cc:302] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b3d6857a6354a7caf3062d16466b8f5, f53a3e9a70954fd4afec9881c8684b88; no voters:
I20260809 19:01:10.505293 26770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:10.505728 26770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [term 1 LEADER]: Becoming Leader. State: Replica: 3b3d6857a6354a7caf3062d16466b8f5, State: Running, Role: LEADER
I20260809 19:01:10.505977 26770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.506583 26770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b3d6857a6354a7caf3062d16466b8f5. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.506665 26770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: This master's current role is: LEADER
W20260809 19:01:10.507630 26793 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:01:10.507747 26793 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:01:10.507901 26797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:10.508236 26797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:10.507407 26398 master_runner.cc:186] Error getting master registration for 127.23.229.61:41733: OK, instance_id { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" instance_seqno: 1786302070294521 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:01:10.509862 26398 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:01:10.511685 26689 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [term 1 FOLLOWER]: Refusing update from remote peer 3b3d6857a6354a7caf3062d16466b8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:10.512149 26794 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:10.513595 26748 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b3d6857a6354a7caf3062d16466b8f5. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.513685 26748 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:10.520151 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.507251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.23.229.60:34573)
0809 19:01:10.507301 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.507304 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.511500 (+ 4196us) server_negotiation.cc:407] Connection header received
0809 19:01:10.511607 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.511608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.511620 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.511651 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.512738 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.513522 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.515366 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.515700 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.515767 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.517249 (+ 1482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.517251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.517251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.517259 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.518869 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.519255 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.519256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.519256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.519308 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.519524 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.519525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.519525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.519656 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.519767 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.519963 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.520053 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 19:01:10.521811 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.505051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49038 (local address 127.23.229.62:42303)
0809 19:01:10.505112 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.505114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.507698 (+ 2584us) server_negotiation.cc:407] Connection header received
0809 19:01:10.507801 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.507802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.507812 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.507843 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.508718 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.509461 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.510538 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.510858 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.510902 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.512989 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.512990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.512991 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.512998 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.514749 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.520833 (+ 6084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.520835 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.520835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.520917 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.521166 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.521167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.521167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.521320 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.521440 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.521613 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.521713 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 19:01:10.525116 26770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.525230 26770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:10.525219 26748 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.525305 26748 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:10.525892 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.507023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38844 (local address 127.23.229.61:41733)
0809 19:01:10.507260 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.507262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.511339 (+ 4077us) server_negotiation.cc:407] Connection header received
0809 19:01:10.511419 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.511420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.511432 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.511491 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.512779 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.513453 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.514512 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.514824 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.514890 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.521998 (+ 7108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.522000 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.522000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.522009 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.523681 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.524112 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.524114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.524114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.524177 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.524402 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.524403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.524404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.524561 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.524645 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.525709 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.525796 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210}
I20260809 19:01:10.530846 26613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } attempt: 3
Aug 09 19:01:10 dist-test-slave-jq4t krb5kdc[26380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 19:01:10.537002 26797 catalog_manager.cc:1347] Generated new cluster ID: 7fa3159a48bc4144b3e4a125e821d7f0
I20260809 19:01:10.537060 26797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:10.539831 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.531109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:34573 (local address 127.0.0.1:56502)
0809 19:01:10.531193 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.531203 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.531238 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.531505 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.531506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.531673 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.531723 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.531724 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.532709 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.532710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.533519 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.533522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.534596 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.534597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.534656 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.535236 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:10.535242 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.536822 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.538713 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.538714 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.538715 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.538927 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.539167 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:10.539167 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:10.539168 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:10.539224 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:10.539525 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.539526 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.539571 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.539632 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.539729 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 19:01:10.540203 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.531307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56502 (local address 127.23.229.60:34573)
0809 19:01:10.531346 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.531348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.531355 (+ 7us) server_negotiation.cc:407] Connection header received
0809 19:01:10.531375 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.531375 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.531396 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.531458 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.531802 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.532615 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.534155 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.534475 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.534539 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.536920 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.536921 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.536921 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:10.536928 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.538619 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.539019 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.539020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.539020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.539097 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:10.539286 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:10.539287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:10.539287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:10.539439 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.539498 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.540034 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.540113 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 19:01:10.541944 26613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: Bootstrap starting.
I20260809 19:01:10.542769 26613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:10.543079 26613 log.cc:824] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:10.544057 26613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: No bootstrap required, opened a new log
I20260809 19:01:10.546198 26613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.546383 26613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58cb1608eca54e17bbff6c64cb0f1288, State: Initialized, Role: FOLLOWER
I20260809 19:01:10.546519 26613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } }
I20260809 19:01:10.547006 26613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:10.547133 26576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:10.548107 26576 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [term 1 FOLLOWER]: Refusing update from remote peer 3b3d6857a6354a7caf3062d16466b8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:10.548679 26814 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:10.548758 26577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b3d6857a6354a7caf3062d16466b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "58cb1608eca54e17bbff6c64cb0f1288"
I20260809 19:01:10.549676 26577 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b3d6857a6354a7caf3062d16466b8f5 in term 1.
W20260809 19:01:10.550912 26830 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:01:10.550978 26830 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:01:10.551491 26817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.551591 26817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:10.551652 26817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.551705 26817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:10.551544 26833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b3d6857a6354a7caf3062d16466b8f5. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.551815 26833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:10.552954 26835 mvcc.cc:205] Tried to move back new op lower bound from 7316693280812765184 to 7316693280793276416. Current Snapshot: MvccSnapshot[applied={T|T < 7316693280812765184}]
I20260809 19:01:10.589572 26814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b3d6857a6354a7caf3062d16466b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b3d6857a6354a7caf3062d16466b8f5" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 42303 } } peers { permanent_uuid: "58cb1608eca54e17bbff6c64cb0f1288" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 41733 } } peers { permanent_uuid: "f53a3e9a70954fd4afec9881c8684b88" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 34573 } } }
I20260809 19:01:10.589712 26814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:10.592195 26797 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:10.593020 26797 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:10.604417 26797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b3d6857a6354a7caf3062d16466b8f5: Generated new TSK 0
I20260809 19:01:10.604672 26797 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 19:01:10.634691 26504 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.632951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49042 (local address 127.23.229.62:42303)
0809 19:01:10.633010 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.633012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.633992 (+ 980us) server_negotiation.cc:407] Connection header received
0809 19:01:10.634108 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.634110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.634122 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.634154 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.634617 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49042: BlockingRecv error: recv got EOF from 127.0.0.1:49042 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 19:01:10.635533 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.633377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38852 (local address 127.23.229.61:41733)
0809 19:01:10.633420 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.633422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.634952 (+ 1530us) server_negotiation.cc:407] Connection header received
0809 19:01:10.635076 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.635077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.635089 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.635119 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.635469 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38852: BlockingRecv error: recv got EOF from 127.0.0.1:38852 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 19:01:10.636320 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.633724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56504 (local address 127.23.229.60:34573)
0809 19:01:10.633782 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.633784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.635772 (+ 1988us) server_negotiation.cc:407] Connection header received
0809 19:01:10.635875 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.635876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.635887 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.635927 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.636254 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56504: BlockingRecv error: recv got EOF from 127.0.0.1:56504 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260809 19:01:10.638602 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.637798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38856 (local address 127.23.229.61:41733)
0809 19:01:10.637832 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.637834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.638064 (+ 230us) server_negotiation.cc:407] Connection header received
0809 19:01:10.638181 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.638182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.638201 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.638232 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.638556 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38856: BlockingRecv error: recv got EOF from 127.0.0.1:38856 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 19:01:10.641713 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.640925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38862 (local address 127.23.229.61:41733)
0809 19:01:10.640958 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.640960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.641210 (+ 250us) server_negotiation.cc:407] Connection header received
0809 19:01:10.641309 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.641310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.641321 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.641350 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.641669 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38862: BlockingRecv error: recv got EOF from 127.0.0.1:38862 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 19:01:10.645838 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.645007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38870 (local address 127.23.229.61:41733)
0809 19:01:10.645043 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.645044 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.645295 (+ 251us) server_negotiation.cc:407] Connection header received
0809 19:01:10.645400 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.645401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.645412 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.645443 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.645788 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38870: BlockingRecv error: recv got EOF from 127.0.0.1:38870 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 19:01:10.652073 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.651185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38886 (local address 127.23.229.61:41733)
0809 19:01:10.651225 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.651227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.651482 (+ 255us) server_negotiation.cc:407] Connection header received
0809 19:01:10.651591 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.651592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.651605 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.651636 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.652018 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38886: BlockingRecv error: recv got EOF from 127.0.0.1:38886 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 19:01:10.662467 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.661494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.23.229.61:41733)
0809 19:01:10.661539 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.661541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.661819 (+ 278us) server_negotiation.cc:407] Connection header received
0809 19:01:10.661929 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.661930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.661943 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.661988 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.662403 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38898: BlockingRecv error: recv got EOF from 127.0.0.1:38898 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 19:01:10.681169 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.680055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38910 (local address 127.23.229.61:41733)
0809 19:01:10.680105 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.680108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.680410 (+ 302us) server_negotiation.cc:407] Connection header received
0809 19:01:10.680570 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.680571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.680585 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.680619 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.681082 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38910: BlockingRecv error: recv got EOF from 127.0.0.1:38910 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 19:01:10.715565 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.714786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38922 (local address 127.23.229.61:41733)
0809 19:01:10.714862 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.714865 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.715001 (+ 136us) server_negotiation.cc:407] Connection header received
0809 19:01:10.715080 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.715081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.715094 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.715147 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.715496 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38922: BlockingRecv error: recv got EOF from 127.0.0.1:38922 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 19:01:10.781845 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.780972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.23.229.61:41733)
0809 19:01:10.781062 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.781064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.781175 (+ 111us) server_negotiation.cc:407] Connection header received
0809 19:01:10.781284 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.781285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.781305 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.781375 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.781772 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38924: BlockingRecv error: recv got EOF from 127.0.0.1:38924 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 19:01:10.912065 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:10.911249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38930 (local address 127.23.229.61:41733)
0809 19:01:10.911329 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.911332 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.911427 (+ 95us) server_negotiation.cc:407] Connection header received
0809 19:01:10.911537 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.911538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.911553 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.911629 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.912010 (+ 381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38930: BlockingRecv error: recv got EOF from 127.0.0.1:38930 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 19:01:11.170418 26620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:11.169646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38944 (local address 127.23.229.61:41733)
0809 19:01:11.169731 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:11.169733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:11.169745 (+ 12us) server_negotiation.cc:407] Connection header received
0809 19:01:11.169860 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:11.169863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:11.169882 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:11.169946 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:11.170334 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38944: BlockingRecv error: recv got EOF from 127.0.0.1:38944 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:01:11.499586 26767 catalog_manager.cc:1259] Loaded cluster ID: 7fa3159a48bc4144b3e4a125e821d7f0
I20260809 19:01:11.499679 26767 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: loading cluster ID for follower catalog manager: success
I20260809 19:01:11.500531 26767 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: acquiring CA information for follower catalog manager: success
I20260809 19:01:11.500813 26767 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f53a3e9a70954fd4afec9881c8684b88: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:01:11.551523 26830 catalog_manager.cc:1259] Loaded cluster ID: 7fa3159a48bc4144b3e4a125e821d7f0
I20260809 19:01:11.551621 26830 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: loading cluster ID for follower catalog manager: success
I20260809 19:01:11.552603 26830 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: acquiring CA information for follower catalog manager: success
I20260809 19:01:11.552950 26830 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 58cb1608eca54e17bbff6c64cb0f1288: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:01:11.686599 26933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:11.683893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38946 (local address 127.23.229.61:41733)
0809 19:01:11.684045 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:11.684047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:11.684058 (+ 11us) server_negotiation.cc:407] Connection header received
0809 19:01:11.684188 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:11.684190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:11.684255 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:11.684346 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:11.684560 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.685109 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.685845 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.686047 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.686098 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:11.686246 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:11.686367 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:11.686425 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:11.686459 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 19:01:11.686477 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260809 19:01:11.691099 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:11.688711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56520 (local address 127.23.229.60:34573)
0809 19:01:11.688817 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:11.688819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:11.688838 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:01:11.688955 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:11.688955 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:11.688994 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:11.689064 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:11.689176 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.689671 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.690358 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.690563 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.690611 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:11.690749 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:11.690860 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:11.690920 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:11.690959 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 19:01:11.690977 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":59,"threads_started":1}
I20260809 19:01:11.696019 26933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:11.693178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38950 (local address 127.23.229.61:41733)
0809 19:01:11.693229 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:11.693230 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:11.693428 (+ 198us) server_negotiation.cc:407] Connection header received
0809 19:01:11.693486 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:11.693487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:11.693500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:11.693553 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:11.693708 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.694253 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.695189 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.695480 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.695536 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:11.695687 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:11.695724 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:11.695786 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:11.695886 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 19:01:11.695923 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 19:01:11.696099 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:11.693100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56522 (local address 127.23.229.60:34573)
0809 19:01:11.693233 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:11.693236 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:11.693262 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:01:11.693328 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:11.693329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:11.693339 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:11.693399 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:11.693551 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.694284 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.695140 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.695440 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.695503 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:11.695825 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:11.695856 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:11.695922 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:11.696010 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 19:01:11.696032 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260809 19:01:11.696465 26959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:11.692994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.23.229.62:42303)
0809 19:01:11.693557 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:11.693559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:11.693567 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:01:11.693616 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:11.693617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:11.693666 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:11.693759 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:11.693880 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.694609 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.695500 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.695767 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.695832 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:11.696019 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:11.696125 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:11.696189 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:11.696381 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 19:01:11.696405 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":71,"threads_started":1}
I20260809 19:01:11.698614 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26398
I20260809 19:01:11.705634 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26508
I20260809 19:01:11.719583 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26624
2026-08-09T19:01:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3069 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:11 dist-test-slave-jq4t krb5kdc[26965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:11 dist-test-slave-jq4t krb5kdc[26965](info): set up 2 sockets
Aug 09 19:01:11 dist-test-slave-jq4t krb5kdc[26965](info): commencing operation
krb5kdc: starting...
W20260809 19:01:12.974484 24468 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/test-user.keytab.
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.229.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
Entry for principal kudu/127.23.229.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab.
I20260809 19:01:13.103596 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40923
--webserver_interface=127.23.229.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:40923,127.23.229.61:33963,127.23.229.60:40155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:13.192696 26982 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:01:13.192989 26982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:13.193023 26982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:13.193070 26982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:13.194244 26982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:13.194319 26982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:13.194344 26982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:13.194365 26982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:13.194399 26982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:13.195991 26982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:40923,127.23.229.61:33963,127.23.229.60:40155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.62.keytab
--principal=kudu/127.23.229.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.62:40923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.229.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:13.196293 26982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:13.196606 26982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:13.201752 26997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.201793 26992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.201794 26991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:13.201983 26982 server_base.cc:1034] running on GCE node
I20260809 19:01:13.202266 26982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:13.202555 26982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:13.203723 26982 hybrid_clock.cc:648] HybridClock initialized: now 1786302073203703 us; error 37 us; skew 500 ppm
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:13.206568 26982 init.cc:377] Logged in from keytab as kudu/127.23.229.62@KRBTEST.COM (short username kudu)
I20260809 19:01:13.207098 26982 webserver.cc:460] Webserver started at http://127.23.229.62:35195/ using document root <none> and password file <none>
I20260809 19:01:13.207345 26982 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:13.207417 26982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:13.207571 26982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:13.208787 26982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data/instance:
uuid: "03a762cd94df48489319aa2ff219631d"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "8ffd4da03aa9c03068fe2bb3c29044b7"
server_key_iv: "455109d8af0e8ab58b6a0d5098c134ab"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.209180 26982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/wal/instance:
uuid: "03a762cd94df48489319aa2ff219631d"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "8ffd4da03aa9c03068fe2bb3c29044b7"
server_key_iv: "455109d8af0e8ab58b6a0d5098c134ab"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.210678 26982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:01:13.211583 27007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:13.211807 26982 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:01:13.211935 26982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/wal
uuid: "03a762cd94df48489319aa2ff219631d"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "8ffd4da03aa9c03068fe2bb3c29044b7"
server_key_iv: "455109d8af0e8ab58b6a0d5098c134ab"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.212025 26982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:13.224874 26982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:13.227412 26982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:13.227598 26982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:13.232534 26982 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.62:40923
I20260809 19:01:13.232586 27076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.62:40923 every 8 connection(s)
I20260809 19:01:13.232995 26982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:13.234094 27077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:13.235845 27077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:13.240319 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 26982
I20260809 19:01:13.240424 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-0/wal/instance
I20260809 19:01:13.240653 24468 external_mini_cluster.cc:1428] Setting key a5d7678a1083ea1a42d40199e8ba6e9d
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:13.246748 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.236956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42694 (local address 127.23.229.62:40923)
0809 19:01:13.237096 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.237100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.237131 (+ 31us) server_negotiation.cc:407] Connection header received
0809 19:01:13.237655 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.237658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.237677 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.237765 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.238348 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.239247 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.240200 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.240768 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.240899 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.243243 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.243251 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.243252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.243259 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.245067 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.245472 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.245475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.245476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.245560 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.245793 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.245794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.245794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.246033 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.246126 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.246332 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.246484 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":70,"threads_started":1}
I20260809 19:01:13.246749 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.236729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.0.0.1:42694)
0809 19:01:13.236953 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.236999 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.237459 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.237795 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.237797 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.238071 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.238240 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.238244 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.239360 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.239362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.240093 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.240095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.240887 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.240888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.240953 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.241583 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.241592 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.243147 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.245162 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.245169 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.245171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.245373 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.245631 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.245632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.245632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.245724 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.246115 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.246120 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.246188 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.246299 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.246555 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":101,"thread_start_us":127,"threads_started":1}
I20260809 19:01:13.247591 27077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:13.248050 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.247880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41788)
0809 19:01:13.247959 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.248024 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 19:01:13.248217 27011 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
I20260809 19:01:13.248742 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.248614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41804)
0809 19:01:13.248671 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.248707 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 19:01:13.248879 27077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:33963: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.23.229.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab.
Entry for principal kudu/127.23.229.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab.
I20260809 19:01:13.267506 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:33963
--webserver_interface=127.23.229.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab
--principal=kudu/127.23.229.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:40923,127.23.229.61:33963,127.23.229.60:40155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:01:13.298177 27077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } attempt: 1
I20260809 19:01:13.298830 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.298666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41820)
0809 19:01:13.298742 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.298787 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 19:01:13.299235 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.299129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41834)
0809 19:01:13.299180 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.299208 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 19:01:13.299324 27077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:33963: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
W20260809 19:01:13.354542 27088 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:01:13.354809 27088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:13.354841 27088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:13.354885 27088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:13.356073 27088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:13.356146 27088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:13.356170 27088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:13.356191 27088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:13.356222 27088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:13.357771 27088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:40923,127.23.229.61:33963,127.23.229.60:40155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.61.keytab
--principal=kudu/127.23.229.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.61:33963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.229.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:13.358078 27088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:13.358321 27088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:13.363741 27096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.363754 27100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.363754 27097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:13.364058 27088 server_base.cc:1034] running on GCE node
I20260809 19:01:13.364365 27088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:13.364698 27088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:13.365895 27088 hybrid_clock.cc:648] HybridClock initialized: now 1786302073365869 us; error 41 us; skew 500 ppm
I20260809 19:01:13.367477 27077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } attempt: 2
I20260809 19:01:13.367949 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.367802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41840)
0809 19:01:13.367876 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.367917 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 19:01:13.368335 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.368227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41848)
0809 19:01:13.368280 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.368306 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 19:01:13.368443 27077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.61:33963: Network error: Client connection negotiation failed: client connection to 127.23.229.61:33963: connect: Connection refused (error 111)
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:13.368893 27088 init.cc:377] Logged in from keytab as kudu/127.23.229.61@KRBTEST.COM (short username kudu)
I20260809 19:01:13.369407 27088 webserver.cc:460] Webserver started at http://127.23.229.61:45701/ using document root <none> and password file <none>
I20260809 19:01:13.369653 27088 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:13.369724 27088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:13.369884 27088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:13.371029 27088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data/instance:
uuid: "cf62e91138e44ddbaf40c68a4cf86c55"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "af8c83494359e69c0f3ef8aeb0d4706b"
server_key_iv: "9a756391b939946beee2a92b3efd9c4a"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.371408 27088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/wal/instance:
uuid: "cf62e91138e44ddbaf40c68a4cf86c55"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "af8c83494359e69c0f3ef8aeb0d4706b"
server_key_iv: "9a756391b939946beee2a92b3efd9c4a"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.372928 27088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 19:01:13.373677 27111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:13.373867 27088 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 19:01:13.373994 27088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/wal
uuid: "cf62e91138e44ddbaf40c68a4cf86c55"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "af8c83494359e69c0f3ef8aeb0d4706b"
server_key_iv: "9a756391b939946beee2a92b3efd9c4a"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.374073 27088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:13.393461 27088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:13.396432 27088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:13.396672 27088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:13.402150 27088 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.61:33963
I20260809 19:01:13.402184 27194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.61:33963 every 8 connection(s)
I20260809 19:01:13.402621 27088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/data/info.pb
I20260809 19:01:13.403656 27195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:13.405426 27195 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:13.407454 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 27088
I20260809 19:01:13.407568 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-1/wal/instance
I20260809 19:01:13.407781 24468 external_mini_cluster.cc:1428] Setting key 85a6a9636973ccb62514d2849afe5a41
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.229.60@KRBTEST.COM; defaulting to no policy
I20260809 19:01:13.416612 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.406268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42696 (local address 127.23.229.62:40923)
0809 19:01:13.406341 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.406343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.406568 (+ 225us) server_negotiation.cc:407] Connection header received
0809 19:01:13.407163 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.407164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.407179 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.407278 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.408117 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.408719 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.410260 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.410499 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.410569 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.413434 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.413435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.413436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.413451 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.415027 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.415464 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.415465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.415466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.415531 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.415816 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.415817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.415817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.415991 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.416067 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.416390 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.416512 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:01:13.416832 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.406225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.0.0.1:42696)
0809 19:01:13.406443 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.406481 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.407033 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.407384 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.407388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.407744 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.408015 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.408021 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.408821 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.408822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.410150 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.410153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.410642 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.410643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.410837 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.411486 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.411506 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.413312 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.415111 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.415120 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.415123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.415365 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.415627 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.415628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.415628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.415747 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.416069 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.416077 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.416233 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.416344 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.416571 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":122,"threads_started":1}
I20260809 19:01:13.417484 27195 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.229.60@KRBTEST.COM" created.
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:13.426041 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.417835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41864)
0809 19:01:13.417892 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.417903 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.417962 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.418194 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.418194 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.418343 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.418392 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.418393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.419399 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.419400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.420210 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.420213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.420794 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.420795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.420864 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.421378 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.421383 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.422587 (+ 1204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.424916 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.424918 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.424918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.425112 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.425359 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.425359 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.425359 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.425417 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.425781 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.425781 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.425821 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.425886 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.425969 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 19:01:13.426218 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.417877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41864 (local address 127.23.229.61:33963)
0809 19:01:13.418053 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.418062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.418079 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:01:13.418096 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.418097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.418109 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.418193 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.418476 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.419272 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.420301 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.420701 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.420794 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.422689 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.422706 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.422706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.422713 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.424813 (+ 2100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.425206 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.425210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.425211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.425282 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.425486 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.425487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.425487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.425707 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.425807 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.425960 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.426057 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
I20260809 19:01:13.426976 27195 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:13.427366 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.427241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59318)
0809 19:01:13.427292 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.427345 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 19:01:13.427541 27116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
I20260809 19:01:13.427989 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.427899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59322)
0809 19:01:13.427946 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.427972 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 19:01:13.428139 27195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:40155: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.229.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab.
Entry for principal kudu/127.23.229.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab.
I20260809 19:01:13.439572 24468 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskI_GCfH/build/release/bin/kudu
/tmp/dist-test-taskI_GCfH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:40155
--webserver_interface=127.23.229.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab
--principal=kudu/127.23.229.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.229.20:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.229.62:40923,127.23.229.61:33963,127.23.229.60:40155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:01:13.459669 27077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } attempt: 3
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:13.467159 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.460138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41880)
0809 19:01:13.460218 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.460232 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.460296 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.460497 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.460498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.460683 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.460770 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.460772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.461499 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.461501 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.462061 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.462064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.462505 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.462507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.462597 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.463109 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.463114 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.464404 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.466185 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.466186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.466187 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.466358 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.466581 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.466581 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.466582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.466638 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.466905 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.466905 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.466948 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.466998 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.467082 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 19:01:13.467221 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.460218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41880 (local address 127.23.229.61:33963)
0809 19:01:13.460293 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.460296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.460308 (+ 12us) server_negotiation.cc:407] Connection header received
0809 19:01:13.460363 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.460365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.460392 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.460465 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.460869 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.461399 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.462167 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.462412 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.462503 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.464516 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.464518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.464518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.464527 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.466097 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.466446 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.466447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.466447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.466512 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.466697 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.466698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.466698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.466840 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.466909 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.467043 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.467128 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:01:13.467658 27077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:13.468005 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.467897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59334)
0809 19:01:13.467948 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.467982 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 19:01:13.468303 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.468247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59344)
0809 19:01:13.468270 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.468290 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260809 19:01:13.468410 27077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:40155: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
I20260809 19:01:13.477392 27195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } attempt: 1
I20260809 19:01:13.477913 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.477790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59352)
0809 19:01:13.477834 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.477873 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 19:01:13.478365 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.478228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59360)
0809 19:01:13.478286 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.478334 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 19:01:13.478533 27195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:40155: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
I20260809 19:01:13.499588 27077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } attempt: 1
I20260809 19:01:13.500188 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.500031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59364)
0809 19:01:13.500114 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.500153 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 19:01:13.500605 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.500513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59370)
0809 19:01:13.500549 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.500583 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260809 19:01:13.500705 27077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:40155: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
W20260809 19:01:13.529027 27205 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:01:13.529261 27205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:13.529279 27205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:13.529299 27205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:13.530501 27205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:13.530547 27205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:13.530562 27205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:13.530575 27205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:13.530628 27205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:13.532224 27205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.229.20:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.229.62:40923,127.23.229.61:33963,127.23.229.60:40155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/krb5kdc/kudu_127.23.229.60.keytab
--principal=kudu/127.23.229.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.229.60:40155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.229.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 19:01:13.532553 27205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:13.532814 27205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:13.538095 27212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.538094 27214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.538101 27216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:13.538453 27205 server_base.cc:1034] running on GCE node
I20260809 19:01:13.538712 27205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:13.539041 27205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:13.540278 27205 hybrid_clock.cc:648] HybridClock initialized: now 1786302073540267 us; error 51 us; skew 500 ppm
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:13.543292 27205 init.cc:377] Logged in from keytab as kudu/127.23.229.60@KRBTEST.COM (short username kudu)
I20260809 19:01:13.543833 27205 webserver.cc:460] Webserver started at http://127.23.229.60:45887/ using document root <none> and password file <none>
I20260809 19:01:13.544121 27205 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:13.544202 27205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:13.544373 27205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:13.545670 27205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data/instance:
uuid: "3350a957a917476a987138c6e906b1f4"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "f10a10f33e0dc6c0edfd49af7020d2f0"
server_key_iv: "bc4e49d645d1c47f9cfc6fccf39db0e8"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.546101 27205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/wal/instance:
uuid: "3350a957a917476a987138c6e906b1f4"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "f10a10f33e0dc6c0edfd49af7020d2f0"
server_key_iv: "bc4e49d645d1c47f9cfc6fccf39db0e8"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.546698 27195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } attempt: 2
I20260809 19:01:13.547194 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.547033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59376)
0809 19:01:13.547107 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.547153 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 19:01:13.547647 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.547503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59382)
0809 19:01:13.547570 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.547609 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 19:01:13.547766 27195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.229.60:40155: Network error: Client connection negotiation failed: client connection to 127.23.229.60:40155: connect: Connection refused (error 111)
I20260809 19:01:13.548048 27205 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:01:13.548918 27226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:13.549120 27205 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 19:01:13.549216 27205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data,/tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/wal
uuid: "3350a957a917476a987138c6e906b1f4"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-jq4t"
server_key: "f10a10f33e0dc6c0edfd49af7020d2f0"
server_key_iv: "bc4e49d645d1c47f9cfc6fccf39db0e8"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.549273 27205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:13.563027 27205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:13.565547 27205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:13.565673 27205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:13.569880 27205 rpc_server.cc:307] RPC server started. Bound to: 127.23.229.60:40155
I20260809 19:01:13.569936 27306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.229.60:40155 every 8 connection(s)
I20260809 19:01:13.570309 27205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/data/info.pb
I20260809 19:01:13.571421 27308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:13.573169 27308 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:13.575855 27077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } attempt: 2
I20260809 19:01:13.576184 24468 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskI_GCfH/build/release/bin/kudu as pid 27205
I20260809 19:01:13.576298 24468 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskI_GCfH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301787754163-24468-0/minicluster-data/master-2/wal/instance
I20260809 19:01:13.576576 24468 external_mini_cluster.cc:1428] Setting key db203ad91427eceac7d763855a0af8da
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.62@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 19:01:13.586787 27082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.576158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59394)
0809 19:01:13.576216 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.576226 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.576271 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.576631 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.576632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.576877 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.576927 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.576929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.578287 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.578288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.578884 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.578886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.579403 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.579405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.579468 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.581211 (+ 1743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.581216 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.582731 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.585180 (+ 2449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.585182 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.585182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.585559 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.585875 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.585876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.585876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.585944 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.586441 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.586442 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.586486 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.586562 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.586673 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 19:01:13.586896 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.573933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.23.229.62:40923)
0809 19:01:13.573995 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.573997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.574228 (+ 231us) server_negotiation.cc:407] Connection header received
0809 19:01:13.574746 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.574748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.574762 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.574814 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.575441 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.576045 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.577676 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.577888 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.577969 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.583505 (+ 5536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.583506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.583507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.583514 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.585466 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.585957 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.585958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.585959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.586020 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.586236 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.586237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.586238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.586416 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.586493 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.586747 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.586815 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 19:01:13.587334 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.576256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59394 (local address 127.23.229.60:40155)
0809 19:01:13.576444 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.576448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.576464 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:01:13.576508 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.576511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.576531 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.576609 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.577021 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.578186 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.578982 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.579288 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.579389 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.582822 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.582831 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.582831 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.582839 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.585101 (+ 2262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.585667 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.585671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.585671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.585781 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.586022 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.586023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.586023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.586366 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.586452 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.586627 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.586778 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":92,"threads_started":1}
I20260809 19:01:13.587460 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.573883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.62:40923 (local address 127.0.0.1:42700)
0809 19:01:13.574103 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.574141 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.574627 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.574896 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.574899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.575141 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.575342 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.575347 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.576167 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.576168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.577597 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.577599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.578057 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.578058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.578157 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.581337 (+ 3180us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.581346 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.583415 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.585563 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.585571 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.585573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.585875 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.586103 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.586103 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.586104 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.586168 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.586525 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.586533 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.586608 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.586950 (+ 342us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.587079 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":110,"threads_started":1}
I20260809 19:01:13.587466 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.577035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59402 (local address 127.23.229.60:40155)
0809 19:01:13.577280 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.577282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.577315 (+ 33us) server_negotiation.cc:407] Connection header received
0809 19:01:13.577407 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.577407 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.577417 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.577491 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.578302 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.578956 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.579772 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.579992 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.580044 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.584072 (+ 4028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.584073 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.584074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.584081 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.585982 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.586358 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.586359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.586359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.586416 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.586626 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.586626 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.586627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.586742 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.586874 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.587284 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.587366 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":112,"threads_started":1}
I20260809 19:01:13.588027 27308 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:01:13.589496 27077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d: Bootstrap starting.
I20260809 19:01:13.590268 27077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:13.590586 27077 log.cc:824] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:13.591605 27077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d: No bootstrap required, opened a new log
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:13.593598 27077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
I20260809 19:01:13.593763 27077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a762cd94df48489319aa2ff219631d, State: Initialized, Role: FOLLOWER
I20260809 19:01:13.593861 27077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.62@KRBTEST.COM
I20260809 19:01:13.594192 27318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.594350 27318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:13.594242 27077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:13.595949 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.588265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.61:33963 (local address 127.0.0.1:41896)
0809 19:01:13.588411 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.588421 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.588458 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.588641 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.588642 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.588798 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.588861 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.588862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.589806 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.589808 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.590590 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.590593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.591157 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.591159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.591242 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.591533 (+ 291us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.591537 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.592769 (+ 1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.594695 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.594696 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.594697 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.594919 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.595170 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.595171 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.595171 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.595241 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.595606 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.595607 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.595654 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.595731 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.595846 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260809 19:01:13.596035 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.588376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41896 (local address 127.23.229.61:33963)
0809 19:01:13.588456 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.588458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.588467 (+ 9us) server_negotiation.cc:407] Connection header received
0809 19:01:13.588556 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.588557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.588569 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.588636 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.588962 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.589713 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.590685 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.591026 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.591096 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.592863 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.592865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.592866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.592874 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.594596 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.595025 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.595026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.595027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.595089 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.595326 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.595327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.595328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.595496 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.595573 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.595805 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.595922 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:01:13.596874 27308 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } has no permanent_uuid. Determining permanent_uuid...
W20260809 19:01:13.597057 27341 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:01:13.597488 27341 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:01:13.598097 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.588274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42716 (local address 127.23.229.62:40923)
0809 19:01:13.588310 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.588312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.588319 (+ 7us) server_negotiation.cc:407] Connection header received
0809 19:01:13.588338 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.588339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.588347 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.588397 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.589007 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.589703 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.590470 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.590718 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.590785 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.594768 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.594769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.594770 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.594777 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.596455 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.596899 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.596900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.596900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.596960 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.597183 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.597184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.597184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.597320 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.597481 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.597913 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.597997 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.60@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 19:01:13.598531 26982 master_runner.cc:186] Error getting master registration for 127.23.229.61:33963: OK, instance_id { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" instance_seqno: 1786302073400612 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:01:13.601752 26982 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.229.61@KRBTEST.COM
I20260809 19:01:13.604995 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.597121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59412)
0809 19:01:13.597193 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.597203 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.597240 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.597362 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.597363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.597530 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.597575 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.597577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.598665 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.598666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.599377 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.599379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.599848 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.599849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.599894 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.600371 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.600377 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.601883 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.603903 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.603904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.603904 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.604106 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.604297 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.604297 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.604297 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.604345 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.604709 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.604710 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.604747 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.604791 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.604886 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 19:01:13.605389 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.597195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59412 (local address 127.23.229.60:40155)
0809 19:01:13.597244 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.597246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.597265 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:01:13.597285 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.597286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.597298 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.597360 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.597664 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.598468 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.599468 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.599766 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.601967 (+ 2201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.602007 (+ 40us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.602008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.602008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.602013 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.603810 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.604183 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.604184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.604185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.604232 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.604403 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.604404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.604404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.604628 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.605189 (+ 561us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.605230 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.605309 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 19:01:13.607026 27308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: Bootstrap starting.
I20260809 19:01:13.607483 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.598858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41912 (local address 127.23.229.61:33963)
0809 19:01:13.598893 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.598895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.599021 (+ 126us) server_negotiation.cc:407] Connection header received
0809 19:01:13.599042 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.599043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.599053 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.599097 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.599802 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.600539 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.601492 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.601773 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.601850 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.604340 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.604341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.604342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.604350 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.606094 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.606526 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.606528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.606528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.606595 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.606829 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.606830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.606830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.606978 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.607160 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.607205 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.607281 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 19:01:13.607867 27308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:13.608202 27308 log.cc:824] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:13.609005 24468 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:13.609169 27308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: No bootstrap required, opened a new log
I20260809 19:01:13.610042 27047 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "03a762cd94df48489319aa2ff219631d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42716
I20260809 19:01:13.610215 27047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 19:01:13.610265 27047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:13.610940 27308 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
I20260809 19:01:13.611063 27308 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3350a957a917476a987138c6e906b1f4, State: Initialized, Role: FOLLOWER
I20260809 19:01:13.611119 27308 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
I20260809 19:01:13.611250 27047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
I20260809 19:01:13.611402 27345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.611469 27308 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:13.611531 27047 leader_election.cc:288] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [CANDIDATE]: Term 1 election: Requested vote from peers cf62e91138e44ddbaf40c68a4cf86c55 (127.23.229.61:33963), 3350a957a917476a987138c6e906b1f4 (127.23.229.60:40155)
I20260809 19:01:13.611488 27345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:13.611804 27267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03a762cd94df48489319aa2ff219631d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3350a957a917476a987138c6e906b1f4"
I20260809 19:01:13.612824 27267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:13.614245 27267 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a762cd94df48489319aa2ff219631d in term 1.
I20260809 19:01:13.614492 27011 leader_election.cc:302] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a762cd94df48489319aa2ff219631d, 3350a957a917476a987138c6e906b1f4; no voters:
I20260809 19:01:13.614640 27318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:13.614815 27318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [term 1 LEADER]: Becoming Leader. State: Replica: 03a762cd94df48489319aa2ff219631d, State: Running, Role: LEADER
I20260809 19:01:13.614913 27318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
I20260809 19:01:13.615466 27318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03a762cd94df48489319aa2ff219631d. Latest consensus state: current_term: 1 leader_uuid: "03a762cd94df48489319aa2ff219631d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.615541 27318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:13.622051 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.612823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41924 (local address 127.23.229.61:33963)
0809 19:01:13.612926 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.612928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.613345 (+ 417us) server_negotiation.cc:407] Connection header received
0809 19:01:13.613447 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.613449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.613461 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.613536 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.614357 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.615154 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.616271 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.616661 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.616711 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.618447 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.618448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.618449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.618456 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.620452 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.620939 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.620940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.620941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.621007 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.621223 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.621224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.621225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.621386 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.621487 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.621833 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.621922 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 19:01:13.622861 27362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:13.623615 27362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:13.624571 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.612878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42732 (local address 127.23.229.62:40923)
0809 19:01:13.612962 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.612964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.613510 (+ 546us) server_negotiation.cc:407] Connection header received
0809 19:01:13.614452 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.614453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.614465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.614495 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.617124 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.617861 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.618954 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.619273 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.619331 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.620758 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.620759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.620760 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.620767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.622544 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.623555 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.623556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.623557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.623630 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.623864 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.623865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.623865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.624005 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.624091 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.624348 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.624447 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:01:13.626827 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.613083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59428 (local address 127.23.229.60:40155)
0809 19:01:13.613131 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.613133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.617257 (+ 4124us) server_negotiation.cc:407] Connection header received
0809 19:01:13.617362 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.617363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.617374 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.617412 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.618182 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.618872 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.619951 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.620249 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.620293 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.622538 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.622540 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.622540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.622548 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.625665 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.626008 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.626009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.626010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.626067 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.626293 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.626294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.626295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.626420 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.626545 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.626640 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.626721 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 19:01:13.625180 27205 master_runner.cc:186] Error getting master registration for 127.23.229.61:33963: OK, instance_id { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" instance_seqno: 1786302073400612 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:01:13.627453 27205 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 19:01:13.629189 27382 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:01:13.629247 27382 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:01:13.638880 27195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } attempt: 3
I20260809 19:01:13.641881 27267 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [term 1 FOLLOWER]: Refusing update from remote peer 03a762cd94df48489319aa2ff219631d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:13.642271 27359 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:13.644047 27345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03a762cd94df48489319aa2ff219631d. Latest consensus state: current_term: 1 leader_uuid: "03a762cd94df48489319aa2ff219631d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.644167 27345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 19:01:13 dist-test-slave-jq4t krb5kdc[26965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.229.61@KRBTEST.COM for kudu/127.23.229.60@KRBTEST.COM
I20260809 19:01:13.646668 27359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03a762cd94df48489319aa2ff219631d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.646785 27359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:13.647229 27345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03a762cd94df48489319aa2ff219631d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.647334 27345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:13.647485 27387 mvcc.cc:205] Tried to move back new op lower bound from 7316693293632901120 to 7316693293527769088. Current Snapshot: MvccSnapshot[applied={T|T < 7316693293632901120}]
I20260809 19:01:13.648087 27362 catalog_manager.cc:1347] Generated new cluster ID: 486d0481da31407ca51ecd3840489cf0
I20260809 19:01:13.648146 27362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:13.651175 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.639199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.229.60:40155 (local address 127.0.0.1:59442)
0809 19:01:13.639254 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.639267 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.639309 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.639483 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.639484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.639695 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.639759 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.639762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.640795 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.640796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.641620 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.641622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.642754 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.642756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.642833 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.643369 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.643375 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.645070 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.649314 (+ 4244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.649316 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.649317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.649579 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.650014 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.650015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.650016 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.650086 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.650835 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.650837 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.650887 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.650947 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.651070 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 19:01:13.652165 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.639259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59442 (local address 127.23.229.60:40155)
0809 19:01:13.639321 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.639323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.639333 (+ 10us) server_negotiation.cc:407] Connection header received
0809 19:01:13.639393 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.639395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.639407 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.639460 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.639850 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.640698 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.641707 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.642610 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.643045 (+ 435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.645312 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.645313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.645314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.645322 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.649142 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.649742 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.649743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.649744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.649881 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.650220 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.650221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.650221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.650648 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.651693 (+ 1045us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.651772 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.651972 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 19:01:13.654346 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: Bootstrap starting.
I20260809 19:01:13.655129 27195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:13.655470 27195 log.cc:824] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:13.656512 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: No bootstrap required, opened a new log
I20260809 19:01:13.658624 27195 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
I20260809 19:01:13.658794 27195 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf62e91138e44ddbaf40c68a4cf86c55, State: Initialized, Role: FOLLOWER
I20260809 19:01:13.658887 27195 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } }
I20260809 19:01:13.659216 27393 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.659361 27152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:13.659516 27393 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:13.660532 27152 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [term 1 FOLLOWER]: Refusing update from remote peer 03a762cd94df48489319aa2ff219631d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:13.660920 27318 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:13.659281 27153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03a762cd94df48489319aa2ff219631d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cf62e91138e44ddbaf40c68a4cf86c55"
I20260809 19:01:13.661780 27153 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a762cd94df48489319aa2ff219631d in term 1.
I20260809 19:01:13.659256 27195 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:13.663625 27393 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03a762cd94df48489319aa2ff219631d. Latest consensus state: current_term: 1 leader_uuid: "03a762cd94df48489319aa2ff219631d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.663715 27393 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:01:13.663865 27396 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03a762cd94df48489319aa2ff219631d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.664032 27396 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 19:01:13.665343 27424 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:01:13.665447 27424 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:01:13.668776 27362 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:13.669553 27362 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:13.677542 27359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03a762cd94df48489319aa2ff219631d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a762cd94df48489319aa2ff219631d" member_type: VOTER last_known_addr { host: "127.23.229.62" port: 40923 } } peers { permanent_uuid: "cf62e91138e44ddbaf40c68a4cf86c55" member_type: VOTER last_known_addr { host: "127.23.229.61" port: 33963 } } peers { permanent_uuid: "3350a957a917476a987138c6e906b1f4" member_type: VOTER last_known_addr { host: "127.23.229.60" port: 40155 } } }
I20260809 19:01:13.677692 27359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:13.685550 27362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03a762cd94df48489319aa2ff219631d: Generated new TSK 0
I20260809 19:01:13.685796 27362 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 19:01:13.717237 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.715328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41934 (local address 127.23.229.61:33963)
0809 19:01:13.715397 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.715399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.716464 (+ 1065us) server_negotiation.cc:407] Connection header received
0809 19:01:13.716604 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.716605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.716618 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.716648 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.717141 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41934: BlockingRecv error: recv got EOF from 127.0.0.1:41934 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 19:01:13.718116 27312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.715756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59456 (local address 127.23.229.60:40155)
0809 19:01:13.715800 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.715802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.717479 (+ 1677us) server_negotiation.cc:407] Connection header received
0809 19:01:13.717652 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.717653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.717665 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.717696 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.718054 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59456: BlockingRecv error: recv got EOF from 127.0.0.1:59456 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 19:01:13.718833 27084 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.716153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42746 (local address 127.23.229.62:40923)
0809 19:01:13.716195 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.716197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.718305 (+ 2108us) server_negotiation.cc:407] Connection header received
0809 19:01:13.718420 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.718421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.718432 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.718462 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.718769 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42746: BlockingRecv error: recv got EOF from 127.0.0.1:42746 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 19:01:13.721483 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.720739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41936 (local address 127.23.229.61:33963)
0809 19:01:13.720778 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.720779 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.720965 (+ 186us) server_negotiation.cc:407] Connection header received
0809 19:01:13.721070 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.721071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.721091 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.721120 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.721436 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41936: BlockingRecv error: recv got EOF from 127.0.0.1:41936 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 19:01:13.724607 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.723750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41940 (local address 127.23.229.61:33963)
0809 19:01:13.723786 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.723788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.724046 (+ 258us) server_negotiation.cc:407] Connection header received
0809 19:01:13.724146 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.724147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.724159 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.724189 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.724561 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41940: BlockingRecv error: recv got EOF from 127.0.0.1:41940 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 19:01:13.728509 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.727682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41956 (local address 127.23.229.61:33963)
0809 19:01:13.727717 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.727719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.727962 (+ 243us) server_negotiation.cc:407] Connection header received
0809 19:01:13.728061 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.728062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.728074 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.728103 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.728440 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41956: BlockingRecv error: recv got EOF from 127.0.0.1:41956 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 19:01:13.734773 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.733652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41960 (local address 127.23.229.61:33963)
0809 19:01:13.733690 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.733692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.733958 (+ 266us) server_negotiation.cc:407] Connection header received
0809 19:01:13.734069 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.734070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.734101 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.734131 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.734723 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41960: BlockingRecv error: recv got EOF from 127.0.0.1:41960 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 19:01:13.745237 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.744172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41966 (local address 127.23.229.61:33963)
0809 19:01:13.744220 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.744222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.744579 (+ 357us) server_negotiation.cc:407] Connection header received
0809 19:01:13.744694 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.744695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.744709 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.744743 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.745163 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41966: BlockingRecv error: recv got EOF from 127.0.0.1:41966 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 19:01:13.763762 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.762643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41972 (local address 127.23.229.61:33963)
0809 19:01:13.762696 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.762698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.763088 (+ 390us) server_negotiation.cc:407] Connection header received
0809 19:01:13.763210 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.763212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.763226 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.763259 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.763692 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41972: BlockingRecv error: recv got EOF from 127.0.0.1:41972 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 19:01:13.798430 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.797398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41988 (local address 127.23.229.61:33963)
0809 19:01:13.797448 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.797450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.797782 (+ 332us) server_negotiation.cc:407] Connection header received
0809 19:01:13.797890 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.797891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.797905 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.797936 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.798368 (+ 432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41988: BlockingRecv error: recv got EOF from 127.0.0.1:41988 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 19:01:13.865118 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.864119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41998 (local address 127.23.229.61:33963)
0809 19:01:13.864179 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.864182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.864331 (+ 149us) server_negotiation.cc:407] Connection header received
0809 19:01:13.864427 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.864429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.864444 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.864509 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.865028 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41998: BlockingRecv error: recv got EOF from 127.0.0.1:41998 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 19:01:13.995328 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:13.994453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42004 (local address 127.23.229.61:33963)
0809 19:01:13.994530 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.994532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.994652 (+ 120us) server_negotiation.cc:407] Connection header received
0809 19:01:13.994739 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.994740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.994754 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.994842 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.995247 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42004: BlockingRecv error: recv got EOF from 127.0.0.1:42004 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 19:01:14.253582 27201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:01:14.252872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42014 (local address 127.23.229.61:33963)
0809 19:01:14.252949 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.252951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.252999 (+ 48us) server_negotiation.cc:407] Connection header received
0809 19:01:14.253049 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.253051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.253064 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.253131 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:14.253489 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42014: BlockingRecv error: recv got EOF from 127.0.0.1:42014 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 19:01:14.629820 27382 catalog_manager.cc:1259] Loaded cluster ID: 486d0481da31407ca51ecd3840489cf0
I20260809 19:01:14.629951 27382 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: loading cluster ID for follower catalog manager: success
I20260809 19:01:14.630790 27382 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: acquiring CA information for follower catalog manager: success
I20260809 19:01:14.631088 27382 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3350a957a917476a987138c6e906b1f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:01:14.666004 27424 catalog_manager.cc:1259] Loaded cluster ID: 486d0481da31407ca51ecd3840489cf0
I20260809 19:01:14.666098 27424 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: loading cluster ID for follower catalog manager: success
I20260809 19:01:14.666900 27424 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: acquiring CA information for follower catalog manager: success
I20260809 19:01:14.667212 27424 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cf62e91138e44ddbaf40c68a4cf86c55: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:01:14.769729 27529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.766981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42028 (local address 127.23.229.61:33963)
0809 19:01:14.767113 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.767115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.767150 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:01:14.767229 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.767230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.767294 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.767391 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:14.767547 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.768063 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.768921 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.769133 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.769201 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.769357 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:14.769482 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:14.769546 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.769578 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.769599 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
I20260809 19:01:14.774376 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.771867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59470 (local address 127.23.229.60:40155)
0809 19:01:14.771983 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.771984 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.771992 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:01:14.772035 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.772036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.772076 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.772151 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:14.772235 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.772775 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.773529 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.773735 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.773800 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.773938 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:14.774061 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:14.774124 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.774221 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.774240 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":62,"threads_started":1}
I20260809 19:01:14.779273 27529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.776237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42038 (local address 127.23.229.61:33963)
0809 19:01:14.776394 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.776396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.776433 (+ 37us) server_negotiation.cc:407] Connection header received
0809 19:01:14.776569 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.776571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.776587 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.776696 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:14.776900 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.777496 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.778483 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.778777 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.778841 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.779013 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:14.779049 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:14.779075 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.779171 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.779194 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260809 19:01:14.779392 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.776264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.23.229.62:40923)
0809 19:01:14.776447 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.776449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.776457 (+ 8us) server_negotiation.cc:407] Connection header received
0809 19:01:14.776531 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.776532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.776592 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.776690 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:14.776842 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.777667 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.778521 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.778748 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.778826 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.779037 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:14.779127 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:14.779158 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.779273 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.779298 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260809 19:01:14.780279 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.776605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59478 (local address 127.23.229.60:40155)
0809 19:01:14.776644 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.776646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.776852 (+ 206us) server_negotiation.cc:407] Connection header received
0809 19:01:14.776962 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.776963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.776979 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.777030 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:14.777157 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.777857 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.779419 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.779734 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.779802 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.780016 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:14.780053 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:14.780084 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.780181 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.780203 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 19:01:14.781461 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 26982
I20260809 19:01:14.796681 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 27088
I20260809 19:01:14.806279 24468 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskI_GCfH/build/release/bin/kudu with pid 27205
2026-08-09T19:01:14Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3088 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6157 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (287068 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST